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ABSTBACT , ^ 

The Onited States Environmental Protection Agency 
(EPA) provided a program of training courses in the preyention, 
reduction, and control of water pollution for personnel of federal, 
state, and local governmental ageticies, private industries, and 
universities. A triangulation app^pach was pursued in the 
instrumentation concept. That is, three evaluation instruments were 
developed. These were; ^ (1) a questionnaire to be sent 'to the students 
after they had returned to* their hojies following completion of the 
course; (2) a participant observ^r^anual in which prestructured 
j^rms were designed for making ob/servations relative to topic 
/g^uencing, teachirrg techniques, ^ntent, instructors^ knowledge of 
^ the subject^ instructors* transferability, visual aids, physical 
facilitie^s, and morale; and (3) a subject matter test to be used for 
determining ^student growth' in number of correct responses. Eleven 
course variables were analyzed in light of questionnaire and 
participant observer data. Findings were presented for each of the 
variables. Another analysis related to growth in learning in terms of 
change in score in the pretest and post-test and th^^ extent the 
students consdder the learning to be valuable in helping them to do a 
better job aid enhance their advancement. Eecommendatio^ were made. 
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CHAPTER I 



^INTRODUCTION TO THE STUDY 



Introduction 

The United States Environmental Protection Agency 

(EPA) provided a program of direct training courses in 

the prevention, reduction, and control of water pollution 

The term "direct training" means all 
technical and professional' training 
conducted by EPA for personnel of ^tate > 
and local governmental agencies, other 
Federal Agencies, private indXistries , ^ 
universities, and other non-EPA agencies ^ 
and organizations.-^ 

EPA personnel directed the proqram and, in most 
instances, taught the purses. There were occasio^, 
however, when lecturer's^ and consultants who could con- 
tribute significantly from their specific knowledge and 
experience were drawn from other Federal, State "and 
local agencies, universities, and industry. 

The program consisted' of a variety of^ short-term 
(three to ten days duration) technical courses for 
scientists, engineers^ and other professional personnel 
assigned responsibilities in this area of environmental 



U.S. Environmental Protection Agency, Order 
1800, lA dated November 19, 1973, Manpower Dovolopmon t 
-and Training — General, p* 1*^ ^ : ^ 

, 11 



concern. Detailed consideration and appraisal of the 
newest developments in specific areas were? provided, 
together with an opportunity for practice in the use and 
f.application of current control techniques. Visual aids, 
closed-circuit television, labora'tory demonstrations, 
problem sessions, and panel discussions were proctrammed 
into a number of course pres^tations . Laboratory and 
field practice under the guidance of experts was included 
in the course agenda where appropriate. 

The courses were conducted in the classrooms of 
EPA at a number of locations throughout the country. 
Technical courses provided intensive training in basic 
elemnnts and methodology. In addition, several broad 
covcracie courses were offered for those in technical 
administrative positions who wished to acqtiire an over- 
all perspective in specif ic . scientific areas. ^ The 
broad spectrum of courses offered ranged from basic 
training designed for personnel with little or no expe- 
rience to highly specialized learning modes designed to 
meet the needs of more sophisticated personnel. 

In assessing water pollution control it was evi- 
dent that the control of municipal-sewered discharges 
was one of the highest national priorities. Municipal 
wastewater treatment plants ranged from minor holding 
tanks to highly complex oporationn that permit water to 
bo eventually ^^rt^l^cled into a community's v/ater supply. 



As changes occur in wastewater treatment t-i&chnology , 
and as quality standards require greater reliability of 
performance, additional manpower wbuld be required. In 
aiddition, the qualifications of many of those employed 
would' require updating. > 

M6:^m|>irical analysis and evaluation had been 
performed on any of the EPA direct training courses m 
the prevention |, reduction, and control of vater pollu- 
tion. No evaluation instruments existed which h^d jDeen 
specifically^ designed to accommodate the unique charac- 
teristics of 'these courses. * 'f' 

In this study, instruments were designed specif 
cally for the evaluation of these courses a:nd were used 
in one of these courses: Orientation to W^^stewater 
Treatment' Operation . It was felt that selection of thi 
course would facilitate, maximum i:^lization o£ the 
research /from two points of view. First, the instru- 
ments and model developed could prove to be useful to 
:^PA and other institutions in evaluating training 
courses. Second, ''the resulting recommendations should 
prove helpful to training of future students, in this 
course, to better meet national and log^ manpower 



r equirem ents in nrnvSo^ a nd qual i-tyr--^^ 



Legislativ^:'Backgr6hnd / . 

■ A review of the history of 'water pollution control 
legislation in the XJni'tpd^ States revealed that there has 
been an ever-increasing emphasis upon wastewater' treat- 
ment and upon the associated training^ requirements^ The 
results of the review of the history were the basis of 
selecting the particular course for use of the instru- 
ments in this xe^^atch. 

Following Is an abstract 6f^ the history of water 
pollution 'COtitrol' legislation. In the interest of clarity 
ho" attempt had been made to cite 'those extensions of acts 
or amendments that were not pertinent to the subject 
matter^ 

Prior to 1948 most of the responsibility for con^ 
trolling water pollution resided Vith state and local 
governments. The only federal legislation in *this area - 
was an ia99 law prohibiting oil pollu-Jiion from ocean- 
going vessels t , . 

The Water Pollution Control Act of 1948 opinionized 
that the Control of water pollution was a state and 
local rest>orisibility ^but that the federal government 
should aid the financing of facilities by providing 
loans- to aetata, and local governments, Miong_ other _ 
areas of water pollution control, the Act provided for . 
support of research related to treatment of industrial 
wastes which were not susceptible to known effective 

,/" 14-' 
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means of treatment. It also provided that facilities 
be established at Cincinnati, Ohio, for conducting 
research, the study of water pollution, and the training 

of personnel in work related to the control of water 

1 . ' 

jpollution, 

. - In 1956 the Act was amended to change what had been 
temporary autho^ty to permanent authority and what had 
been a system of loans to a system of grants. Also, 
the Act authorised that training in technical matters 
relating to the causes, prevention, and control of 
water pollution be provided to personnel of public 
agencies and oth^r persons -with suitable qualifications. 

Because Congress had become dissatisfied with the 
progress of pollution control , a new Federal Water* 
Quality lict of 1965 was adopted. This Act increased 
support for research and development, increased funding 
for construction of sewage treatment works , and strength- 
epe(f the role of the federal government in the enforce- 
ment of wajj^r pollution control and the establishment 
of water quality cri\:eria, 

Y 

The present law, the Federal Water Pollution 
control Act Amendments of 1972 , provided for further 
increases in emphasis on ad v an c ed and improved waste- 
water treatment methods and procedures and speqifically 
stated in Sec. 104(a) that: ^ 



i 




The Administrator of the Environmental 
Protection Agency shall establish national 
programs for the prevention, reduction, 
and elimination of pollution, and,. as ^ 
part of such programs, shall — ° 

(1) in cooperation with other Federal, k' 
State, and local agencies, conduct and 
promote- the coordination and acceleration 
of, research, investigations, experiments, 
training , demonstrations, surveys, and « 
studies relating to the causes, effects, ^ 
^ extent, prevention , reduction , and ,^ v 

"elimination of pollution ,2 ^^^'k^^^'^^ 

The course selected for use of the instruments 

this research wa^ .the one which apparently woi^|^be, 

significant, in the future, i:^J:^rms of the number of 

people to be trained and th^; Magnitude of the effect 

tf ' .. ., V 

upon water pollution abatement and control, ^ 

'* ^ ■ . . . . 

yd..' 

Statement'^f. the ]®bblem 

^ % ' — 

No evaluaition of experimental design had been made 

of any of the direct training courses given by EPA 
Water Programs Operations at Cincinnati Ohio . With 
the increased emphasis upon wastewater treatment tech-- 
nology and the present known* need and future needs pre- 
dicted to trairr and/or retrain personnel in these disci- 
plines, it was timely and important that courses be 
analyzed and evaluated in terms of their effectiveness 
and that recoinmendations be made Qoncerning future 
planniiigi^and , assessment techniques. 



^Federal Water Pollution Control Act Amendments 
of 1972 U.S. Code , Vol. 33, Sec. 1251 (1973). 
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In the past, the extent of course evaluation has 
been confined to distributing a single shorf form to 
course" attendees , during the final day of the course, 
in order to obtain their reactions confined to subject 
matter and presentation techniques. This /-practice may 
have been of some value to the training personnel. * 
There- was strong evil^ence, however, that having a stu- 
dent fill out a reaction form while still at the train- 
ihg site had little value because the student -was 
reluctant to be critical, even constructively so. This 
type of instrument was easy to administer and rather 
painless to analyze, but it tended to build trainer ego 
since the results were almost always positive. 

■ / To make comprehensive determinations concerning 
extent of course effectiveness/ it was necessary that a 
variety of assessment instruments be used for collect- 
ing pertinent data. To date, no known instrumentation 
package has been developed and used by EPA in training 
course evaluation. 

. Significance of the Stxj^y 

Organizatioiis , such as EPA, that conduct training 
courses and the o^ganizaJ:ions from which the students 
were provided were /spending millions of dollars each 
year for tl^ev training, of personnel in many disciplines. 
It was generally believed that there was a payoff for 

17- 



these expenditures, but little evidence existed that 
this presumption was justified. Tremendous amounts of 
time, money, and effort could be wasted in training 
courses in which the effectiveness of the course and the 
extent 'to which students "learned subject matter were 
undetermined . 

The training personnel of EPA Water Programs 
Operations w^r^ extremely interested in receiving an 
assessment of their courses. It was felt that other 
such organizations would have the same concern and thus 
be potentially interested in the evaluation instruments 
devex^ped in this study and the recommendations, that 
resulted from their use. " ' (^'"'^^ 

In typical in-house training programs the manag^N^ 
ment of the organization had parochial interests. 
These included: increasing output, reducing scrap, and 
increasing quality. These^ benef ite'd^he organization 
and it was relatively convenient to measure levels of 
performance or behavior before and after training. Such 
was not the case, however, in courses of the type 
addressed in this study. The courses were broad in 
content, and. the students were sent from many different 
organizations. Because of these factors there was 
little commonality to the bena|its realized by the 
organizations and in some of the organizatipns there 
was little concern related to behavior before and after 



training,' 

The training' courses given by EPA served a diver- \ 
sified group of students and thereby were thought to . 
offer an advantage in providing* the student interaction 
with persons from other organizations. Exchange of 
information and problems was thought to be. a valuable 
aspect of .this kind of program. • • 

One difficulty with this type of program, however, 
was that the courses were not tailored to fit the exact 
needs of an organization who sent a student for training 
or the needs of that student. To accommodate, to the 
extent possible, the diversity of students and the 
organizations from which they were sent, the courses 
should contain aspects of 

retraining, upgrading; and p^^^^flfe d<li>4lopment. 



This study was significant because it represented 
the first comprehensive and systematic approach to the 
evaluation of courses given by EPA Water Program 
Operations • It was felt that the results of this 
research would provide the training personnel of EPA 
Water Programs Operations with recommendations, which 
if accepted and implemented could be of assistance to 
them in increasing the value of the courses to the 
students and to the organizations that they represent. 
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Scope and -^Limitations of the Study 
1. Scope of the Study ^ , 

The scope o£ this study was confined to: 

1. Develppirig three instruments for the 
evaluation of direct training courses: a student 
questionnaire, a participant observer manual, and 
a subject matter test. ^ 

2. Using these instruments in a training 
course titled, Orientation to- Wastewater Tr^ at- 
ment Operation, provided in Cincinnatti, Ohio 
from Decyember 2 through ^D^ember 6, 1974, by the 
Water Progjfams Operations National Training 
Center of the United States Environmental. Pirotec- 
tion Agency. 

3. Analyzing data derived from use of 
instruments to determine: 

A. Effectiveness , o:^ course in terms of: 

1) Subject matter appropriateness 

2) Teaching techniques 

3) Length of course 

4) Sequencing of subject matter 

5) Pace or progress of the course 

6) Theoretical or practical content 

7) Instructor's' knowledge of the 
subject 

8) Instructors' transfer ability 

20 
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9) Physical facilities 

10) Visual aids 

11) Morale 

B. Growth in learning in terms of 
change in score in the pretest and 
post-test and the extent the students 
consider the learning to be valuable 
in helping them to do a better job 
and enhance 1;heir advancement. 

C, Useability of instruments 

4. Recommending improvements for future 
courses and assessment techniques. 

2. Limitations of the Study 

It was not the purpose of this study to design 
instruments from which it could be determined whether 
or not there was a correlation between the training 
program and work procedures, work performance, promo- 
tions, or salary increases of personnel participating 
in the courses. 

It was not the intent of this study to refine the 
couripe Objectives which had .been established l?y person- 

nel /of the EPA Water Programs Operations prior to the 

/ 

conduct of this study. This study made no attempt to 
determine whether or not the objectives were appropriate. 

It was not the purpose of this study to statisti- 
cally validate or determine the reliability of instruments, 
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Figure 1 is a flow chart .^depicting the model which 
was developed in this research. 

The researcher first conducted a literature review 
The basic sources for this were ERIC,- Education Index, 
Comprehensive Index to^issertations , and studies by 
other government' agencies related to training course- 
evaluation research and instrument design. 

The flow chart clearly shows the "triangulation" 
approach to the development of- instrumentation. That* * 
is, there is one sub-path for the student questionnaire, 
one for participant observer manual, and one for the 
subject matter test. 

The flow of the questionnaire shows sequentially 
the development, criticism, redesign, trial, mailing, 
and response from which data were derived, 

' The flow of the participant observer manual depict 
the development of the manual^ the selection of thQ 
observer, the training of Observer, and observation 

during the conduct of the course. Data were recorded 
relative to the observation. 

The subject matter test was developed after which 
the pretest and post-test were administered to the^ 
students 'from which data were derived. 

The data collected from student questionnaires, 
participant observer, and subject matter tests were 
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analyzed for: effectiveness of the course, growth in 
terms of change in scores on pretests and post-testa^ 
and the useability of the instrumepts. Findings were 
determined /from this analysis. 

In Accordance with the findings, conclusions were 
drawn and recommendations were made relative to future 
training courses and assessment techniques. 



\ 



CIU^TER II ^ , . 

♦ 

- , LITERATURE REVIEW 

\ 

The baseline sources used in the literature review 
weire ERIC , Education Index , and Comprehensive Index to 
Dissertations . Also reviewed was literature of 'U.S. 
Government institutions such as Department of Defense, 
Internal Revenue Service, National Institute for 
Occupational Safety and Health, and Securities, and 
Exchange Coinmission . In utilizing ERIC and Education 
Index , microfiche and hard copy of the l^bstract were 
reviewed. • Hard copy of the reference materi^^l was 
acquired on a selective basis. In the case of the 
Dissertation Index , after review of abstracts, poten- 
tially relevant subjects were selected and reviewed. 
Descriptors having ^most relevance to this research were 
Course Evaluation, Curriculum Evaluation, Program 
Evaluation, Eva:3^^ation Methods, Evaluation Techniques, 
Course Objectives, Educational Objectives, Training 
Measurement Techniques, Questionnaires, Observation, 
Participant, Training Analysis and Evaluation, Student 
Evaluation of Training and Self Evaluation. 

This researcher reviewed and utilized many relo- 
vant resources in the conduct, of this research , as 

■ ' 2n 

15 * ' 
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rc'flected in the bibliography. -However , "only those 

excerpts haying the^most significant impact upon the 

model developed in this research are cited herein. 

As stated by Weiss, evaluation, in the broad 

sense, is the judging of tnerit against a yardstick. 

• Evaluations is an elastic v/ord that 
/ stretches to cover judgments of 
many kinds. People talk about 
evaluation of a movie script, evalua- 
tion of the sales potential of a new 
detergent. What all tl>e uses of the 
word have in common is .the notion of 
judging merit* Someone is examining 
and weighing a phenomenon (a person, 
a thing, an idea) against some explicit 
' ^ or implicit yardstick. 3 

Tracey took the position that unless one evaluates 
a training course systemically the chances are the 
results will be minimal at best. One extremely impor- 
tant aspect of the results of cours'e evaluation is the 
Sjcptowledge of how the interdependencies relate to each 
''Crther. This position by Tracey, set the scene for the 
researcher to pay much attention to inclb^ing as many 
factors as could be determined. 

The primary and* overriding objective of 
a program of internal evaluation is to 
collect data that v^ill serve as a valid 
\ basis for improving the training or 

development system and maintaining 
quality control over its components. It 
must be emphasized that all components 
ofxthe system and their interaction are ' 



Cai^ol 11. WeisB, Evaluati o n ' Ronoarch: Mothodf^ for 
Assessing l^yogram Effectiveness (Englev/oocTciif f s , N . J . : 
Prcntice-Hair, 1972), p. 1. 
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the objects of scrutiny. The evaluation 
or rating of the instructors separately 
and distinctly from other components of 
the system is not 'the objective. 
Instructors are evaluated only as one 
* of the system components interacting with 

all the others . > - 

A learning situation involves trainees, 
instructors , course content , ^equerw?e , 
time allocations, instructional 
^ strategies, materials, equipment, and 
facilities. If any of these components 
is substandard, the training or develop- 
ment program cannot be optimally effec- 
tive in achieving the desired results. 

Further impetus to the researcher's efforts to 

study all of the elements as a system was provided by ^ 

Rose. . 

Everybody talks about training evaluation, 
but as Mark Twain said about the weather, 
"nobody does much about it." 

7 

Various training techniques have been-' 
subjected to rigorous research. The 
results of these studies are important 
and are used by component training 
specialists, but too often we fail to 
give timely consideration to th^ evalua- 
tion of all elements of courses and 
programs . ^ 

In every training situation the value of the 
training program is largely a function of the quality 
of the instructional objectives. The objectives, accord- 
ing to Duel, are the foundation on which the training 



4 

William R. Tracey, Designing Training and 
Development System Cn.p.: American Management Associa- 
tion;?^ 1971) , p. 334. 

Homer C. Rose, "A Plan for Training Education," 
Training and Development Journal, 22-5 (May 1968), 38. 
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program is b,uilt and therefore it is critical that they 

be well established "and well stated. * I 

if you don't know where you are 

going, you are not likely to get where you 
want to.bQ. But even more important you 
won't know how t^gejb there and, more- 
over, will be unaBle to tell when you 
have ^rrived. Yet a look at many stated 
• objectives of training programs reveals 
that ,i:hey provide ,no sure source of 
direction, and no specified or measurable 
end product . toward v^hich .to point, ^ 

; If we are interested in training 
programs which enable us to meet the 
needs and Requirements of the organiza- 
tion, WiS must be sure that our objectives 
are clearly and precisely stated. The 
quality and utility of fevery training 
action that follows dependent on the 
explicitness of stated objectives. 
In order to develop materials, plan the 
route, select training methods, conduct 
training^ and evaluate results , program 
intentions must be precisely and opera- 
tionally defined. Well-stated objectives 
^ provide tjie critical base from which 

effective and efficient training experi- 
• ♦ Qnces are programmed. ' 

According to Duel, the purpose of training in 

the public service is improvement in job performance 

as related to duties, tasks, and responsibilities. As 

such the objectives at.e- a derivative of training needs. 



^Her/r 



'Hei/ry J. Duel, '^Determining Training Needs and 
Writing Relevant Objectives," Employee Training and 
DeVelopmQTits in the Pub},ic Service , ed. Kenneth T. 
Byers .CC|iicago : Public Personnel Association,. 1970), 
p. 89. 



^Wd, p. 90. 
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For training in the public service, 
the name of the game ^ is training for 
^ impr^bved job performance ; Both current 
and future job performance are, to be 
sure, included. In either event the 
focus of training is on improved perf or- 
, mance o£* assigned duties, tasks c^r. res- 
ponsibilities. Preparation of objectives, 
then, must be preceded by ^ sbund analysis 
" ^ '\ of need for training based on organiza- 
tional requirements, as well as an 
assessment of specific job performance 
requirements. Thus, while objectives 
represent the basic statements from 
^ which training programs are' planned, 

^conducted, and evaluated, they cailnot . 
be directed toward relevant learning 
experiences unless they '-stem 'from a 
determination of training needs. *ln 
the beginning there are training needs . ^ 

The training director should be responsible for 

the collation of ti/aining needs received from func- 

/ ^ 
tional managers. /He would focus on both the needs of 

the individual and the needs of the organization. It 

is the needs tnat are required and from these the 

wants must be^ sifted out. The resulting training 

needs should then be refined so as to be relevant to 

organizational mission. 

In relating objectives and evaluation, Engel 

expressed the importance of communicating the objectives 

to the trainees before and during the training process. 

9 ■ 

Educational, programs— like all ^ 
programs ---begin with goals or objectives 
clearly communicated to all parties 
' having an interest in the outcome: o 



Duel, "Determining Training Needs , and Writing 
Relevant Objectives," p. 90. v 
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trainees / instructors , and administrators. 
As a matter of good teaching practice it 
is wise to re-emphasize these goals to 
the trainees as the course moves forwrard* 
A thorough application of the relation- 
ships between objectives and instruc*^ 
tional outcomes is mandatory for the 
trainer. 9 

. . .the trainees usually want to know 
how they are progressing. Trainees in 
a civil service environment are usually 
adultS/ and adults are more likely -to , 
appreciate specific feedback on "accom.^ 
plishments rather than letter grades or 
marks. For some, formal grading and 
marking systems hold a bit of terror, 
harking back to unfortunate school 
experiences in childhood. Nevertheless 
* trainees want to understand the, relation- 

ship between what they have been taught 
and what they may be per f conning on the 
job.* Almost all are anxious for feed- 
back which reveals whether or not they 
are improving. 10 

In training courses criterion-referenced tests 

*have been found to bf^ino^tlfef f ective. ^t is much more 

meaningful to determine^ what the trainee can or cannot 

do in respect: to a specific task or objective than it 

is to know what specific grade was received on the 

test and what relative standing the trainee had in the 

test. 

A criterion-referenced test has a specific 
standard or score against which learning 
is judged. The test focuses- on what an 



^Herbert M. Engel, "Evaluating Employee Development/' 
Employee Training and Development in the Public Service , 
ed. Kennfeth T. Byers (Chicago: Public Personnal 
Association, 1970)/ p. 253. * 

lOlbid. , p. 255. 
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individual can or. cannot do in respect tp 
' a specific task or objective; it is not 
* designed., to determine an individual's 

relative standing in a group or to assign 
a grade, Thf criterion or standard used 
to judge classroom training is validated 
against job behavior or perfoinnance in 
the^ real world. Therefore, the trainee 
should be confronted with conditions and 
problems on ^ the test that are simulations 
or clQse approximations of the situations" 
he will encounter on the job . -l-l 

Following the establishment of objectives, test 

items should be cons.tructed or selected which measure 

the objectives. Since time limitations make it imprac^ 

tical to test for all possible items, those considered 

most critical should be selected. ' . ' * 

• • Once the objectives for a criterion- 
referenced testing system have been 
delineated, the next step is to construct 
and/or selept test items to measure the 
objectives. Constructing test items 
that will measure an objective is one of 
the most difficult steps in the total 
developmental process because of the vast 
ntamber of test items or tasks that might 
be constructed or selected to measure any- 
given objective. Two or three hundred 
different items may 'be used to measuris 
some aspect of a single objective^ Since 
time limitations make it impractical to 
administer all possible items, the t^^t 
developer should construct test items! 
that measure the' most critical elemeTrts 
of each objectiVre or task. At tiie) end 
of this unit, you should be able to syste- 
matically select critical elements in 
objectives or tasks. -^^ ' 



11 

U.S. Department of the Treasury, Inteirnal Revenue 
Service: Coursebook Test Item Co nstruction works h op On 
Criterion- Rgf eronced Testing , Training #9919M. ^Module 
, 1, April, 1975. 

12 . * 
■^^Ibid. / 
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The terminal input to the sel^tion of assessment 
techniques^ U^ed in this research was influenced by 
Kirkpatric]^in establishing a nq^d for observation in 
conjunction with the reactions a^%he, trainees * This 
was certainly compatible with the notion of evaluation 
using the systems approach. 

H To evaluate training effectively, traiili 

directors should begin by doing a good 

* job of measuring reactions and feelings 

of people who participate. It is impor- 
tant to do so in^an organized fashion 
using written comment sheets which have 
been designed to obtain the desired 
reactions. It is also strongly suggested 
• that the form be so designed that the 
cpmments can be tabulated and quantified. 
In the experience of the staff of the 
Management Institute, it is also desirable 
to have a trained observer make his own 
appraisal of the session in order to 
supplement the reactions of enrollees. 
The combination of these two^ evaluations 
is more meaningful- than either one by 
itself .13 

The basic attributes of the participant observa- 
tion technique were suggested by Tfracey. 

f Observation, in the corfEext of training 

system evali^tion, has certain charac- 
teristics : ■ * 

1. " It is specific . " Observation is not 
just looking around o^^ seeking general 
impressions To be useful there must 
be carefully defined things to look for, 



13 

Donald L. Kirkpa trick, "Evaluation of Training, ^ 
Training and DeveTopment Handbook , ed., Robert L. 
Craig and Lester R. Bittel (New York: McGraw Hill,' 
1967), p. 94, 
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2. It is systematic . Observation is not 
just droppirig in on a training situation. 

. The timing of observations ^ the length 
of the periods, and the nximber of obser- 
vations must be carefully planned and 
scheduled. 

I. . ■ 

3. It is quantitative . Insofar as is 
possible, measurable characteristics 
are the object of study in observation 
used for evaluation* 

4. It is recorded . A record is made of 
observations either during or immediately 
following the visit to tlya classroom or 
training' area. 

5.. It is expert . Observation is conduc- 
ted by fully qualified personnel who have 
been especially trained for the task.f^ 

In considering a (Sefinitioh of learning for this 
stu4y, the researcher subscribed to the learning ele- 
ment' as generally described by Kirkpatrick. The 
notion that understanding the principles, f acts, > and 
techniques cons ti^A&& .^earning yrras ;Lntroduced. 

It is important to recognize that 
favorable reaction to a program " ^ . 
does not assure learning. All of 
us have attended meetings in which 
the conference leader or speaker 
used enthusiasm, showihanship, 
visual aids and illustration to 
make his presentation well 
accepted by the group. A careful 
analysis of'^the subject cojitent 
would reveal that he said practically 
nothing of value — but he did it very 
well. 15 



Tracey, Designing Training and -Development 
Systems , p. 343. 

Kirkpatrick, "Evaluation of Training," p. 96. 
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There are several definitions of 
learning • For the purposes of this 
chapter, learning is defined as 
follows: the principles, fact^, 
and techniques which were under- 
stood by the conferees. In other 
words, it does not include the on- 
the-job use of these principles, 
facts and techniques .-^^ 

The extent of course evaluation required is 

dependent upon such factors as evaluation, needs ,^ time, 

, money, personnel, etc. The notion of a continuum of 

evaluation systems ranging from simple to comprehensive 

was expressed by the United States Civil Service 

Commission. 

The evaluation process should be con- 
^ sidered as a continuum which ranges "^from 

little evaluation (or informal feedbac}^) 
to comprehonsivG evaluation (which would 
include all four data collection methods 
described in this paper — opinion sur- 
veys , class observations , written tests , 
and performance exercises). Naturally, 
the points along, this continuum relate 
to the number and kind of evaluation 
methods employed. The real question 
then becomes f How much evaluation does 
a particular course require? Or, to 
state it differently: 'What point on 
the continuum best represents its 
evaluation needs?-*-^ 

A full scale evaluation plan represents 
considerable time, money, and professional 
competency on the part of the training 



^^Ibld. 



17 

U.S. Civil Service Commission, Bureau of Train- 
ing. Training Evaluation: A Guide to itfe Planning , 
Development, and Use in Agoncy training Courses . 
Training Systems and Technology Series: No. IV. 
Pamphlet T-i3, May, 1971, p. 15. 
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personnel involved. Since increased 
reliability comes at a. high price, it 
♦ must be decided what point On the continu- 
\xm constitutes an acceptable trade off 
between cost and reliability • This 
decision making is further complicated 
because' it does not normally involve 
only a single course, but rather every 
internally developed course, making up 
the a?gency's training program. Agency 
> officials must therefore set priorities 
and assign resources based on their needs 
for information — information which will 
tell them whether or not a given training 
experience has accomplished what was 
intended. 

In summation, the literature review was useful 
in delineating- what has and has not been accomplished ' 
in evaluation of training courses and in suggesting 
types of assessment techniques appropriate for resolving 

the questions to be answered in this research. The 

i 

knowledge gained, about strengths and weaknesses Of 
^techniques typically used, was helpful in the develop- 
ment of instruments for this study and in recommending 
refinements. ^ 



Ibid. 
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CHAPTER III 
DEVELOPMENT OP INSTRUMENTATION 

In this s€uay ci, ^txiangulation" approach was 
pursued. The term "triangulation" referred to the fact 
that three basic evaluation instruments were utilized 
in'the course selected. ' ^'v 

First, a questionnaire was qompleted by students 
when they returned to their jobs aftea^ finishing the 
course. The questionnaire included demographic ques- 
tions such as job type and education. Other personal 
questions asked had to do with the student's purpose in 
enrolling, whether or not he received an increase in 
salary and/or an assignment to another job upon cOmple-* 
tion of the course, appropriateness of the svibject 
matter to his job, and the degree to which the course 
extended his knowledge of wastewater treatment tech- 
nology. A group of questions related tb variables 
allowed the student to make an assessment of the extent 
to which the course content was in accordance with the 
course announcement, how time should ^e distributed by 
teaching techniques, length of coursed course content, 
pace, sequencin;g, instructors' transfer ability, phys- 
ical facilities, visual aids, and student morale. 
-;-) , . 26 ' 
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Space was also allowed for personal comments, 

- second, an individual was trained as a partici- 
pant observer, attended the course selected, and sub- 
mitted observation data in a manual developed bv the 
researcher. Quantified data were recorded relativeVto 
course content, sequenqing, teaching techniqi!i^s,,^-.:5jWual 
aids, instructors' knowledge of the subject, i^tructors' 
ability to transfer knowledge, morale, and pjiysical 
facilities. ' 

Third, students were pretested ari)d post-tested- 
using a s\ibject matter test, generating evidence of 
growth in correct responses. ^ 

The ensuing sections develop further each of the 
evaluation instruments that were selected as a part of 
the "triangulation" approach. 

Student Questionnaire 

1. Questionnaire Development 

a) Variables to be studied 

The first consideration in the design of 
the questionnaire was to determine what data were 
required relative to the"^ course. It was decided that 
the varia^es as referred to in the Scope and Limitations 
of the Study required measurement and \iOUld be researched 
via the questionnaire. ' ' 
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The questions that would be related to the varia- 
bles included the extent to which course content was in 
accordance with the course announcement, how much tiM^ 
should be devoted to each of the types of teaching 
techniques, and an assessment of content, pace, and 
sequencing of the course* In addition, the^ questions 
related ta the variables would also include the instruc- 
tors' knowledge of the subject, instructors* ability to 
transfer knowledge, physical(facilities , visual aids, 
and morale of the students. 

In all of the above the respondent would be 
required to make a selection within a range of answers. 
This wa6 done to f<^cilitate response and to gather 
data in a form most appropriate for collection, and 
analysis. 

p) Demographic and other personal data 

Additionally, it was apparent that certain 
demographic and other personal data would be necessary 
SO that,' in the analysis and evaluation, a particular 
type of student could be identified and determinations 
could be made as to the extent to which the needs of 
this particular type of student were being' met. It 
appeared that this would also provide data from v;hich 
determinations could be made as to the extent to which 
the student's needs and backaround affected. the answers, 

38 * 
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The following demographic and other personal data 
were deemed appropriate and necessary to'-the sttidy: job 
Status; education; purpose in enrolling; whether or not 
the student received an increase in salary as a result 
of taking the course;" whether 02? not the student was 
still working at the same job that he had prior to 
taking the bourse; and the extent to which the subject 
matter of- the \ course was appropriate to the student's 
job. ' 

c) . Other data • ^ 

In addition to questions associated with 

the variables, and demographic and other personal data 

* » 
as described above, it was considered important to pro-^' 

vide space on the questionnaire for personal comments 

of the respondent. The respondent "was free to offer 

comments related to items of the questionnaire or any 

other /Comments that he considered to be relevant and/or 

helpful 'to the study. It allowed the respondent to 

express himself in his own way. 

d-) Mechanical .design 

In constructing the initial draft of the 

questionnaire, consideration was given to the rea^n-- 

dent's time, energy, and sanity. It was felt th^a^?^ ^ 

consideration for the prospective respondent would, ^ 

among other things, promote a larger number of responses 
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■ Care was exercised in the layout, of the question- 
naire so that each question and associated multiple 
choices were set apart distinctly from the adjacent 
questions to make it easier for the respondeat to focus 
on the particular question and choices." Also Jzhe Jtey 
word(s) in each question was underlined so as to keep 
the subject firmly entrenched in the mind of the 
respondent" while making a selection. » 
2. Criticise 'of the Questionnaire 

Vo facilitate data collection andf analysis, the 
initial draft of the questionnaire yras reviev/ed by the 
researcher to ascertain whether or not all of the items 
were otdered in generic groups, such as demoaraphic , 
personal, 'course content, teaching, physical facilities, 
and morale. As a result of this review> a revision 
t v;as made to the draft. 

Copies<of the revised dx;aft were distributed to 
experts in the fields of training, data collection and 
analysis, economics research, program evaluation, and 
public health service. The expertise of these indivi- 
duals was known as was the fact that each would be 
extremely analytical and constructively critical.' All 
were requested not to discuss the questionnaife with 
the others so that independent criticisms would result. 

The criticisms xcceived from the experts v;ero 
extremely valuable t<^ this research. Several inadequaci 

40 
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not previously apparent were revealed. In some instances 
jberms vrere changed to reduce the possibility of misin- 
terpretation. In other instances, related to response 
choices, t^e term used to describe a center selection 
was changed to allow the respondent, some range! I£ 
the center selection ^had been Iqft as a finite point 
this would tend to cause the respondent to"". stay away 
from the central tendency even if it represented his 
true inclination. Other changes resulting from the 
criticism 'related to adding questions and to some extent 
reordering of questions, A copy of the questionnaire 
which evolved as'* a result of the criticism is included 
^s Appendix A. - ^ 

3, Trial of .the Questionnaire - . * 

The course in which th^ evaluation instruments 

were used was Orientation to Wastewater Treatment 

\ 

Operations, course number 173. This course had been 

^ ... f 

given several times over the past few years. The 

^ JO 

» 

students in. these past groups^were similar- in their 
^ background, positions and education, to tho^e who would 
be taking the course to be evaluated. For this reason, 
students who took the cpurse in 1972 and those who took 
the covirse in \(.973 were selected as those to whom 
questionnaires vv(Ou3^ be sent for t;E;ial. 

The mailing lists of the students for these two 
classes were fprnished by training personnel of EPA. 
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* No atteiapt had been inade to update these' lists from the ' 
data fiarni shed with the registration of the stuaent. 
OSiis lEact ca^ased some concern as' to how- current the 
lists were arid how this would affect the response* 

A cover letter ^ for transmittal of the question- 
naire /'was framed to set forth the reason ^^or ♦ the survey r 
the importance of the suq;rvey/ and the fact that the 
respondent of the questionnaire would be in the unique 
position to make a contribution. A prompt reply was - 
reqoiested. A copy <yf the letter. Its included as Appendix 

Questionnaires were^sent to , all nineteen persons . 

who had completed the 1972 course and all sixteen 

persons who had coiripl^ted the 1^73 course" — a total of 

thirty-five. A se/lf-addressed s-Bamped envelope was 

' • ■ ^ / \ ^ - ./ . ^ 

included in the envelope with each questionnaire sent. 

In addition/ a notation, "RETURN ADDRESS REQUESTED/' 

was put on each ^exterioa? envelope , immediately be 16w - 

the return addr^^s. This was done in 'an effor;^ to 

/ 

' maximize returijls and for the purpose of updating the . ^ 
mailing list. /All thirty-five questionnaires were 

mailed on the same day. ' \ 

' ^ ' . ' r . . 

Of the hineteen questionnaires mailed to students 

who had completed the course in 1972/ eleven responses 

were received. All of these were received within 

forty-one days after the questipritiaire was seiit. One 



of the respondents adviseid of an address change.. 

Of the sixteen questionnaires irvailed to students 
»who had completed the course in 1973^ sixteen responses 
were received. All o:^ these v/ere received within tweijity- 
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one days after the questionnaire was sent. Fipur of the 

respondents advised of an address change. \ 

A3 requested /V all twenty-seven respondent^ 

answered each of th'e seventeen multiple choice i^ems 

listed on the questionnaire, (^f the twenty-sevem res-- 

pondents^ eighteen furnishfed information relative to the 

eighteenth item. Personal Comments. The instructions 

^'•■j \ ^ ■ 

had provided that response to this item was optional. 

/ 

The large response obtained, the fact that all 

respondents answered all of the required questions, and 

the fact that none of the respondents made .reference to 

any misunderstanding indicated they had little or no 

problem in addressing the questions and in making a 

choice. Also, there was a strong desire to assist, in 

some fashion, in an evaluation from which possible 

« 

future improvements could be made in the course. 

Following the trial the questionnaire was revised. 
The wording of questions 3 and 4 was changed to accom- 
modate students who had just completed a course. 
Question 6 w^s added to get the student ^s opinion as to 
the extent to which the course extended his knowledge 
of wastewater treatment technology. A copy of the final 
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questionnaire is inducted ^s Appendix 



Participant Observer Manual 

!• Participant Observation as a Technique 

There appeared to be almost as many different 
opinions concerning the value of participant observa- 
tion, as a research tool, ^ as there ^were social scien-- 
tists who used and/or taught the techniques . At one 
end of the spectrum there were those soci^al scientists 
who had profound questions concerning reliability, 
validity, and generalizability of results-. At the other 
end, proponents of participant observatipn "claimed that 
the technique wa.s less likely to be' biased, unreliable, 
or 4-nvalid be'cau&e it accepted and recorded the data 
more objectively and comprehensively than did the other 
methods. Proponents. also considered that its directness 
allowed real study of complex interdepemdencies iti a 
social system. 

In developing the' role to be, played by the partici- 
pant observer in this study, the following questions 
were resolved: • 

1/ Q, Will the observer be furnished prearranged 
observational techniques and structured 
reporting forms or will he be free to make 
y \^ his own choices as tp those observation's ' 

that are cogent? 
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A. In order for the researcher to have the 
data collected in a fashion to facilitate 
- processing/ it would be highly desirably 
» that prearranged. observational techniques 
and structured reporting f orins ,be used. 
Hov/ever, it was recognized that if an 
observation, in the opinion of the observer, 
was significant, in some aspect not accounted 
for in form, a record of the observation 

should be made on plaiii paper. ^ 

Q. Will tjie observer's function be limited to 
the collection of data, or will he also be 
responsible for evaluation of at least some 
of the -data 1> " 

A. For two reasons,' i± was decided that the 
observer's function would be limited to 
data collectic^n. The first of these reasons 
had to do with the fact that evaluation in 
this study should be limited to the researches 
Thfe second reason was that the attention and 
amount of recording required of the observer 

would be such that he would not have time 

>> 

available for evaluation. 
Q. Will the observer be An integral -part of 

the class or peripheral to it? 
A. It was -decided that a student in the class 

4f)- 



could not concenl^rate on learning the course 
material and also be effective in the role 
of observer. It was also decided ihat the 
participant 'Observer should be seated in 
the classroom, 
4, Q, Will the identity and^ purpose of the observer 
be concealed or revealed? 
A. Given the extent of record keeping required 
* of th^ participant observer, his identity 
and his purpose would be made known to 
course participants. 
To recapitulate^^ the setting would be one in which 
the observer was not a student, the observer's identity 
and purpose would be knov/n to the instructors and stu- 
dents, prearranged observations and structured reporting 
forms would be used, and the observer's function would 
be to collect -but not to evaluate the data. 
2, Development of Participant Observer Manual 

The participant observer manual, included as 
Appendix D, was developed by the researcher and used as 
one of the data-gathering instruments. 

In General, the forms in the jmanual were designed 
to facilitate observational quantification of the. same ^ 
variables that were included in the questionnaire sent 
to the students. The questionnaire ^was^ designed to get 
opinions from students who had completed the course, by 

» 
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having them select from a range of answers. For example 
the student was expected to select a choice of excellent 
very good ^ good , f air ^ or poor in response to the ques- 
tion: How do you rate the utilization of visual aids 

s 

as supportive of instruction? In the participant 
observer manual Csee Figure 3) the observer would record 
for each ten minute interval / when- visual aids were 
used and the type of aid that was used. 

The same form CPigure 3) was designed ,to enable 
the observer to make an entr^, for each ten minute 
interval^ concerning whether thie course content was 
theoretical or practical , as well as whether the content 
was technical or non- technical . These terms were, 
defined as follows: 

Theoretical Content — Classroom activity, rega^rdles 
of what teaching technique is utilized, e.g .. lecture, X 
discussion, demonstration .dr. pr|)blem seminar-, which tsj 
devoted to generalization, principled, hypothetical sfl.tu 
ations, concepts, basic propositions, and speculative 
thinking. 

Practical Content — Classroom 'activity, regardless 
of teaching technique used, which is related to situa- 
tions in which the theoretical concepts are ,put into 
specific applications, usages, and experiences. 

Technical Content- — Theoretical and practical sub- 
ject matter related to the fields of engineering, 
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physical sciences, and life sciences. May be presented 
as equations, mixtures of ingredients, phenomena, con- 



discussions, demonstration, or problem seminar. 

Non-technical Content — Theoretical and practical 
subject matter which is not related to that which is 
defined as technical. May be presented in lecture, 
discussion, demonstration, or problem seminar. 

Time measurements by content type would provide 
meaningful data when used in conjunction with the 
answers selected on the student questionnaire. That is? 
if the student reactioris indicated that the course shou^ld 
be a little more practical the researcher would know 
how much of the course was theoretical and how much was 
practical , 

The same rationale was used in making time entries 
relat€2^ to teaching techniques, such as lecture , discus- 
sion , demonstration , and problem seminar^ These terms 
were defined as follows: o 

Lecture — This is a semiformal talk in which the 
instructor presents facts, concepts, or prj-nciple; 
explores a problem; or explains relationships. The 
purpose of a lecture is to inform. Some of the appro- 
priate uses of a lecture are to (1) orient trainees to 
course policies, rules, procedures, (2) introduce a. 



subject and indicate its importance with an overview of 



cepts, and appl*ications . May be presented in lecture. 
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the scope, C3) present basic material which will set a 
common background for subsequent activities C4) set a 
stage for a discussion, demonstration or problem seminar 
C5) illustrate the application of rules, principles or 
concepts, and C6) review, clarify, emphasise, or 
summarize. 

Discussion-- This usually occurs at random during *a 
lecture. The instructor and students consider the pros 
and cons of a particular facet of the subject matter. 

Demonstration— The instructor performs -an opera- • 
tion or does a job, thereby showing the trainees what 
to do and how to do it. He also indicates why, where, 
and when it is done'. This tecshnique is frequently used 
in conjunction with a lecture. 

Problem Seminar— This may take the form of a 
directed group discussion. This would ^include questions 
answers, and comments from the instructor as Veil as 
those from the trainees. The technique provides an 
opportunity to pool the . knowledge and past experience 
of the trainees. The seminar may take the form of a 
meeting set up specifically to find an answer to a. 
question or a solution to a problem. 

Certain items on the questionnaire had to do with 
sequencing of the subject matter s^d pace, or progress 
of the .course. A form (Figure 4) was designed sCh that 
the observer could follow the progress of the subject' 



40 

matter and record the daily order in which the major 
items of the instructor's outline were pazesented 
throughout the course. The major items on Figure 4 were 
taken from the complete topic outline which was furnished 
to. the researcher by the training personnel of Water 
Program Operations, EPA. The complete topic outline is 
included as Appendix? E. ' 

Another form in the manual (Figure 5) was designed 
to enable the observer to make assessments related to 
the instructors' knowledge of the subject ♦ The attri- 
butes were separated into „three. main categories:. 
enterprise knowledge , job knowledge , and job skills . 
Each instructor was to be rated in a ^eparate column. 
The measurements were to be on a five point scale with 
an all "yes'' recorded as a point value of five and an 
all "no" recorded as a point value of one. Point 
values of four, three, and two were to be used for les|^^ 
than all "yes" and more than all "no." 

Figure^ 6 .was designild to enable the observer to 
make measurementfe a?el'a1fed to' the instructors' ability to 
transfer knowledge. The attributes were separated into 
two main categories: - communication skills, oral and 
written and personal qualities . Each instructor was to 
be ra'^ed in a separate column. The measurements were to 
be made on a five point scale same as described above 
for Figure 5. ''The measurements derived from the use of 

' ^50 . ' 
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Figures 5 and 6 were to be observation data which were 
to be 'useful in augmenting the data derived from the 
student ratings on the questionnaire • 

Mea.surements of hedonic tone, the factors which 
measure a feeling of pleasure^ were selected as indica- 
tors of morare. Occurrences of these faqtors as causes 
of good and poor morale were to be rated on a scale of 
full effectiveness to full ineffectiveness Csee Figure 
7) • On the student questionnaire, the general morale of 
the students was to be rated aS excellent , Very g'odd , 
good , fair / or poor . The data gathered by the partici- 
pant observer would provide quantified data relative to 
the factors affecting morale> thereby augmenting the 
data derived froirj the student ratings. 

A one time^ recording relative to physical facili- 
ties was to be made on the form shown in Figuret 8* These 
data were to be-^used in conjunction with the data 
derived from the student questionnaire relative to 
physical facilities. 

The manual was assembled in a fashion to facilitate 
easy manipulation by the observer. That is, each of the 
six forms was attached to a single cardboard panel. The 
binding of the manual could be opened to a single panel 
or an appropriate' pair of panels. 
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^4. Participant Observer Selection^ 

There were a niunber of alternatives available -for 
the selection of a participant observer for this study. ^ 
The alternatives included: the researcher, a*^ training 
instructor, a social scientist, an industrial engineer, 
and a sanitary engineer working in the field of wastewater 
treatment technology, who was disassociated ^with the 
training operations, , 

An analysis, was made in which the E^ros and cons for 
each of the alternatives were considered. It was deter- 
mined that a sanitary engineer working* in the field of 
wastewater treatment technology, who was disassociated 
with the training operations, would be selected. 

This determination was made because, in some of the 
measurements, the observer would be required to have a 
complete understanding of wastewater treatment technology. 
These particular measurements related to content and 
sequencing of course material. In each. of the other 
alternatives, the types of individuals, while having 
some positive attributes, were considered as not having 
the technical background required. It was felt that 
having to provide the participant obseirver with complete 
instructions, definition of terms used, and training in 
the observation techniques and use of data collection 
forms would be much more feasible than having to train 
another type of individual in wastewater treatment technology 

^ 52 



The individual meeting the criteria and possessing 
the strongest interest in and knowledge of • training, 
evaluation, documentation, and social orders was selected. , 
5.' Participant .Observer Training 

. * The rese^archer trained the participant observer. 
The initial training session of two hours duration took 
place several weeks prior to the conduct of the course in 
which the instriiments were to be field tested. As a 
result of this session the researcher recognized the need 
for additiqnal definition of. terms used. Also'', the par- 
ticipant observer .made several constructive suggestions 
for minor changes in data recording instruments. These 
wer6^ considered and as a result, changes were incorporated' 
into the manual. 

The final training session for the participant 
observer, of two hours duration, was held one week in 
advance of the conduct of the course. At this session 
the researcher set up hypothetical situ,atic)nfi^nd with 

the participant observer made appropriate^ entries on the 

/ 

forms. This was continued until the researcher felt 
confident that the participant obse^^^er was well versed 
in every aspect of the role. In a<idition, the parti- 



cipant observer was given instructi^hs tlitat if any 

/ 

unforeseen questions arose at the training site, 
relative to observation concepts of;. data recording, he 
was to get in touch with the researcher by\ telephone at 
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his earliest opportunity. 

Subject Matter Test 

I 

!• Test Development - 

The senior instructor df the course^ who is 
recognized an expert in wastewater treatment opera- 
tion, designed ^fee^^ubject matter test to basic guide- 
lines established by the researcher. A most important 
consideration was designing a test which would contaih 
que.stions relative to each of the' course objectives. 
Another important consideration was thkt the questions 
were to be those most relevant to the bn-the'-job needs 
of the trainees after they completed the course. No 
constraint was imposed as to the exact form of questions 
to be used, but it was strongly recommended that they be 
of the objective typie to facilitate scoring, data collec 
tion, and data analj^sis. 

The same subject matter test, included as Appendix 
F, wag used for pretesting and post-testing. The pur- 
' pose of testing before and after training was to deter- 
mine how much growth occurred in correct responses on 
the pretest and post-test. The intent 6f such a com- 
parison in this study was merely to show a change in 
test scores over the five day training span. It should 
be noted that sufficient data were not sought, at this 
time, to determine whether or not the change was 

VA 
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attributable to the experience of the course. 

/A determination was made as to the extent^o which 
the subject .^matter topics^ covered by the instructQrs^ 
W^re supportive o& course objectives and the extent to 
which questions' cm the subject matter test related to 
subject mattegr^opics^ 

The . objectives of the course^ established by EPA 
Water Programs training personnel^ were that, upon 
course completion, the. trainee would 'be familiar with: 

It Characteristics of wastewater 

2. NPDE3 national strategy 

3. Aquatic- environment and .effects on pollution 

4. Significance of bacteriological data 
monitoring process control testing 

5. Physical and chemical testing and NPDES 
self monitoring process control testing 

6. Treatment operations, identification 
function and problem 'recognition 

These objectives are shown in the first column of 

Table 1. The second column shows all. of the subject 

ma^^^^er^^topics of the course. Each topic is shown opposite 

the ob^jectiy^e to which it relate s. 1 tLJwas„ jde t e rm in ed. 

that '100 percent of the subject matter topics were 

§upportive of^one or other of the course objectives. 

The third column shows the number Cs) of the question (s) 

on the subject ipatter test that relates to a particular 

subject matter topic. An, analysis revealed that questions 
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appeared on the test for fifteen of the eighteen subject 
matter topics (83 percent). The only topics for which , ' 
there were no test question? were: overview of wastewater 
treatment/ wastewater collection considerations, and safety 
dn wastewater treajbment,. ' ^ 

2. , Use of Test 

The participant observer administered the pretest 
and p6st-test to the trainees. The students were told 
that their names would not appear on either of the tests 
and that scores could riot in any wary be associated With 
their names. They were not told that the same instruments 
would be used for both pretest' and post-^test. Each of 
the students drew a ticket from a lot, and the code 
letter appearing on the ticket drawn was used as the 
student's identify code on both the pretest and post-t^st^ 
This ci*oss-cOjde identification facilitated the measuring 
of change in scores for each individual student and at 
the same time provided data for establishing a class 
profile as shown in Figure 2. / 

The pretest was administered by the parti^cipant 
observer on the first day of *the course prior to instruc- 
tion. The instructors and the participant obseryer had 
been cautioned to iftake certain that no student would get 
a copy of the blank test form oi; the completed form for 
his own use, or 'be allowed to make , notes relative to 
the test questions or answers.^ Upon completion of the 



pretest, the participant observer collected the papers* 
which were put^ into the package of material to be " . 
delivered to the researcher. Th^ "instructors did not 
retain a copy of the pretests. ^ Also the instructors \ 
were advised that they should not, in thie conduct of the 
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^y^rse, spec^ically refer to course material as being 
relied to the pretest. The participant observer 
:r^pi;)rted that the instructors complied. 

The post-test was administered ^by the participant 
observer after completion of all formal instruction on 
* the final day of the couirse. After the post-tests were 
CQllected by the participant observer, 'one of the train- 
ing staff made a pho4:ocopy of each of the post^ tests • - 
The copies were given to the participant obseirver to 
include in his package of material for delivery to the 
researcher, and the originals were passed back to the 
students for a discussion of the test and relateid subject 
matter. i 

The pretest and post- test papers, which were 
delivered to the researcher, were scored by the 
researcher. The key for ^.scoring the tests, which had 
been previo\j53ly provided by the instructors, is 
included as Appendix G. 
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CHAP^TER IV 



PRESENTATION OF DATA ^ 

This chapter contains summaries of information 
obtained from the three instriiments utilizfecl, for .the 
collection of data. 

In the Questionnaire Summary the data include a 
frequency of choices fpr the eighteen multiple force choice 
questions on the questionnaire. Also included are all 

of the student comments received in response to question 

7 

19 of the questionnaire. It was pre-established that 

responding to this question was optional with the student. 

The comments received are listed in random order. 

The Participant Observer Manitel Summary consists 

of the actual data collected by the participant observer 

« 

in the Participant Observer Manual. Table 2 shows 
sequencing of subject matter topics. Tables 3,4,5,6, and 
7 show data relative to the teaching technique 'used, 
whether the course was theoretical or practical^ whether 
the course was technical, or non-technical, and the type., 
of visual aid, if any, that was utilized. Tables 8 and 9 
show ratings of instructors' knowledge of the slibject 
and Tables 10 and 11 show ratings of instructors' ability 
to transfer knowledge. Table 12 shows ratings of morale' 
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measurements and Table 13 shows the participant observer's 
assessment of the ph^ical facilitiei^ 

The Subject Matter Test Summacy^ Figure 2, shows 
a profile of pretest and po6t-test scores for each of the 
students tested. 

Data from all of the aforementioned Tables and Figure 
2 were used' in' making the analysis presented in Chapter 5, 

Quest ionnaira Suitunary ' 

A copy of the questionnaire ^ which is included as 
Appendix C, was mailed to each of the thirty-six students 
after they had completed the course. Responses were 
received from thirty-three of the students (91 percent). 
All thirty- three answered all eighteen of the Multiple 
force choice questions. Following is the presentation 
of a summary for each of the questions on the questionnaire. 

1. What was the general category of your job at 
the time you took the course? 

Envirqn- 

Admini- Plant Scien- Auti- Tech- mental 

.strator Operator Engineer > tist tor nician Specialist Total 

2 2 .4 5 8 a ^ A 33 

2. . What is the level of your education? 

Non-High High School Some Bachelor Masters Doctor- 
School Grad. Graduate College \ Degree Degree ate Total 

0 2 7 20 4 0 33 

" 3. Will you receive an increase in salary as a 
result of completing the course? 

Yes No Total 

1 '32 33 
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4, Will you be assigned to another job. as a 
result of completing the course?. 



Yes No Total 

— it" ' 

2 31 33 



5, To what extent was* the subject-matter of the 
course appropriate to your job? ' I 

Exactly Much Fairly So Little Not at All Total 

' 4 16 .10 3^ . rO ) 33 

6, Tp what degree did the course extend your* 
knowledge of watewater treatment technology? 

* 

Very Much Much Some Little" None Total 
7 14 10 : 2 0 33 

7, What was your purpose in enrolling in the course?, 

I 

Become Increase Modernize . Salary Diversity 

Instructor Knowledge Knowledge Promotion Increase Education -Other Total 

0 28 3 0 0 0 2 33 

8^1 To what extent was course content in accordafnce 
with the course anno\incement? 

Exactly , Much Faiyly .So Little Not at All *' Total 

12 14 7 0 0 33 

9, Whclt is your assessment of how the time should 
be distributed among'> various types of - teaching 
techniques? 
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Type 


Much More 


More 


^ Right 


Less 


Much Legs 


Total 


Lecture 


0 


1 


21 


11 


0 


33 


Discussion 


1 


9 


21 


2 


0 


33 


Demonstration 


4 


15 


14 


0 


0 


33 


Problem Seminars 


3 


15 


15 


0 


o" 


33 



10, What is your assessment of the length of the 

course in order to adequately cover the course 
material? 



0,1 



i 
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Much Too A Little About A Little Much Too 
Lonp, ^ Too Long Right Too Short Short Total 

c 

0 6 20 7 0 33 , 

11 • How do you rate the course in terms of its 
theoretical/prpictical content? 

Should be a Should be a ' ^ — 

Lot more • Little more * About Little more Lot more 
theoretical theoretical Right practical practical Total 

0 , 1 15 15 2 . 33 

12 . How do you rate the general pace or progress 
of the course? 

Much Too A Little About A Little Much 

Fast Too Fast RighH Too Slow Too Slow Total 

0 4 ' 18 10 1 33 

13. How do you rate the sequencing of subject 
matter in terms of its having a continuous flow 
and being comprehensible to the students? 

* 

Excellent - Very Good Good Fair Poor . Total 
' ^ 0 10 13 10 0 33., 

14. How do you rate the instructor (s) • knowledge 
of the subject matter? 

Excellent Very Good Good Fair Poor ' Total 
11 . 15 _ 5 2 0 33 

15. How do you rate the instructor (s) • ability to 
transfer his or her knowledge to the students? 

Excellent Very Good Good Fair Poor Total 

2 9 16 6 0 33 

16. How do you rate the physical facilijbies of the 
classroom? 

Excellent Very Good Good Fair Poor Total 

5 19 6 2 1 33 

G2 
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How do you rate the utilization of visual aids 
as supportive of instruction? 

\ Not Quite 

Few Too Many Just Right Enougj j ^ Far Too Few Total 

4 27 1 0 33 

18. How would you rate the general morale of the 
students? 

Excellen t Very Good Good Fair Poor Total 

2 ' 17 11 3 0 - 33 

.19. The following items are those personal comments 
'offered by the students as requested on item 19 
of the questionnaire. Items shown are listed in 
random order. The job type of the respondent 
is shown for each comment . 

• 

Auditor — Although the visual aids were 
generally good, there were too many 
segments using an uninterrupted flow 
of visuals. In addition, there was 
too little imagination used in the 
preparation of the visuals. Flow, for 
instance, can be graphically shown on 
a projection by using polarized light 
to cause an actual flow through the 
visual. In addition a* movie of plant 
operations would have been helpful. 

Environmental Specialist — Not enough time 
spent on operation problems and solutions 
and how to improve existing plants. 

c. Administrator — To really teach more about 
operation the course should be made more 
specific and practical in application . ^ 

d. Auditor — Sessions were too long without breaks. 

e. Auditor-^Could have had less breaks and longer, 
lunch period . - 

f. Engineer — At two of the three treatment ^ 
plants visited, it was extremely difficult 
to get close enough to the instructor or 
treatment plant operator to get any infor- 
mation on the operation of the plant. 
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Far Too Many 
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Auditor-^-The plant visits are good in concept 
but utterly lacking in a practical sense. 
They appeared to be poorly organised and 
we got little out of them, since there was 
no organized attempt to tell the group about 
the plant operation or to follow a specific, 
flow. It was almost impossible to hear any 
of the comments on plant opera-tion unless you 
were next to the speaker. In a group of 
thirty five this is impossible for every 
one. *I believe it would be a good idea to 
brief the groi^p prior to the plant visits, 
to prepare flow charts,, and to discuss the 
aspects of the plant. By so doing the 
people will know what they are looking at 
and j.ust:<tjft/here it fits into the plant 
opeDration . 

Environmental Specialist — Participan'ts should 
have been^ separated more by their relative 
knowledge' of the topics and background. This 
could have been done by offering the course 
in two sessidkis or by separating the parti- 
cipants into two groups according to their 
needs. 

Plant Operator — Since I am with a chemical 
plant I cpuld have used a little more infor- 
mation on industrial waste although I realize 
each plant is an individual case. 

Biologist--More discussion concerning the 
facilities to be visited ahead of time, 
would enable students to better understand 
the facilities . 

Environmentalist — Concerning the field trips- 
I thought more of a briefing on the types of 
plants should have been given. I would have 
liked to have seen an advanced treatment 
facility because I feel this area is the 
least . understood for the beginning student. 

Auditor — The mixed nature of the class 
(technical, audit, etc.) made it difficult 
to" design a course that would meet every- 
one's needs. I, as an auditor, found the 
course a bit too technical. 

Technician — I think it could be advantageous 
to present special problems, e.g., disposal 
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of sludge, as well as solutions, to these 
kinds of problems, which have been imple*- 
mented by various cities. 



Chemist — Overall the course was very well 
perfoirmed but there should be mojfe student 
participation. 

Auditor — There was too little involvement 
of the class in a, give and take mode.. 



Technician-^Insuf f icient use of videotape, 
but excellent u^e of slides. 

Auditor — Some visual aids (slides — which 
presumably contained important information) 
were not left visable long enough. 

Auditor — Instructors generally used 500 
words {ixiclujiing many big ones which 
possible obscure meaning) where 50 would 
have been plenty. 

Auditor — Some instructors spoke too rapidly > 
and in a low voice — not too effective. 

Technician--Some instructors were well 
prepared and had something to say. Others 
wasted our time. 

Environmental Specialist-r-Overall I got quite 
a bit out of the course and was impressed 
by the knowledge and jDackground, of the 
lecturers. 

Auditor — Some instructors were short on 
technical aspects of sewage treatment because 
it was not their field. However, the course 
director was excellent. 

Technician — Some sessions were rather dull 
due to instructor's lack of enthusiasm. 
Much too redundant in , some cases. 

Auditor — Some repetition in lectures. 

Environmentalist — The lecture oVi Physical and 
Chemical Test Review Criteria, which could 
have been complex, was presented in a manner 
that anyone could' understand. 






\ 



56 



z. Technician — Often ip seemed that the instruc- 
tors were not teaching at a level appropriate 
to the group of students. Generally, the 
students' questions indicated more of an 
advanced understanding of wastewater treat- 
ment while the instructors presented a 
superficial orientation to the topic, 

aa. Technician — Lectures were presented on a 

" high school level with no challenge to more 
advanced students . 

ab. Environmentalist — The lectures of two of the 
instructors tended to be too subject . specif ic . 
The topics covered were ^"^propriate to general 
discussion but detailed to general cases 

were not n.ecessary. 

ac. Technician — Most of the instructors were 
very good and the course director did a great 

^; job. One of the instructors was inadequate, 

ad. Auditor — The instructors were excellent except 
for- one who read from a paper. 

ae. Engineer — One of the instructors, in my 
opinion presented the material very poorly. 

af. Technician — 6ne instructor in particular, 

' ' could profit by spending a little more time 

on personal hygiene . 

ag. Environmental Specialist — Some visual aids, 
especially overhead projection aids, tended 
to be of little use. This was n^ot true of 
slides and schematics, however. 

ah. Auditor--The continued use of visuals, 
,j w together with" the lack of student partici- 

// 0^^^^^ pation, caused a frequent loss of attention. 

Participant Observer Manual Summary 

The instructors of the course furnished the researcher 
with a topic outline which is included as Apptendix E. 
This outline included items A through AA on Table 2. 
Items AB through AH on Table 2 were added by the participant 

. GG 
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observer when it was noted that the course matqirial being 
taught was. not appropriately included in one of the 
prescribed topics. Table 2 also contains the sequence in 
'which the topics were taught on each day of the course, 
According .to the participant observer, items B,L,M,R,S,W, 
X,Y, and AA were not taught although there were instances 
when some were casually mentioned. 

The participant observer recorded, for each ten^ 
miniate interval, ^the -teaching technique used, whether the 
course content was theoretical or practical, whether the 
course content was technical or non-ti^chnical , and the 
'^type of visual aid, it any, that was utilized. The summary 
information- fot each of the five days of the course ar^ 
included as Tables 3,4, 5, &, and 7. 

Tables 8 and 9 show the participant observer's 
scoring of seven instructors for attributes, related to 
the i^ist^^tors' knowledge of the subject- In the last 
column on Table ^a frequency distribution is shown fpr 
tha total number of instructors scored for each of the 
attributes that were observed. 

Tables 10 and 11 show the participant observer's 
scoring of seven instructors for attributes related to 
the instructor's ability to transfer knowledge. In the 
last column of figure 2 a frequency distribution is shown 
for the total number of instructors scored for each of 
the attributes that were observed. 

U8 



TABifE. 3 

TECHNIQUES, CONTENT, AND -VISUAL AIDS (FIRST DAY) 
AS 'RECORDED BY PARTICIPANT OBSERVER 
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TABLE 4 

TECHNIQUES,^ CONTENT, AND VISUAL AIDS (SECOND ^QAY) 
AS RECORDED- BY PARTICIPANT OBSERVER 
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fABLE 5' ■ 

TECHNIQUES i CONTENT, AND VISUAL AIDS (THIRD DAY) 
AS RECORDED BY PARTICIPANT OBSERVER 
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' . ; . TABLE 6 

' TECHNIQUES, CONTENT, AND VISUAL AIDS (FOURTH DAY) 
AS RECORDED BY PARTICIPANT OBSERVER 



1 r 

j CLOCK TIME j 


TECHNIQUES 


CONTENT 




VI 


SUAL 


AIDS 


«. 




1 8:30 




DISCUSSION 


/-^ 

o 
p 

2. 

o 

UJ 


< 

< 'f 
55 ^ 


< 

\ % 


< 

1 


< 

is 


o 

IS 
2 

o 


35 MM SLIDE 


sl 

SE 


> 

o ^ 

-4 = 


H 

< 

c 


? 
15 

r- r- 

< 7. 
^ < 


1 9:00 














rt> AT7I 
K A V 1 


^,T.,.-,. 




■ 


r 
1 












X 




X 

V 
















.■X. ■■■■ 
X 


j 9:30-- 






X 
X 




X 

X . 


X 
X 














X 

_. x . <^ 


1 lOiOO" — 






X 
X 

X 




X 
X 

< — ^ 


X . 














X 

X 


10:30- 






X 
X 
X 




X 
X 

r X 


X 

X . 














X 


1 11, nn 










'x 


X 


• 












X 

X 


j 11:30 


~\r-' 

- i 


X 




"if- 




BUS 












( X 
! 


1 12:00 








i 
i 

i 




















12:30 








1 

— 1- 


- 


JUS 
















1 1:00— 
1:30 








X 
X 

X 




— 1 



1— 


X 














.-X — 

X 

. X . . 


1 2:00' — 






■ X 

X 
X 
X 


1 


* 

I ^ 
! X 


X 
X 
X 

x^ 














X _ 
X 
X 
X 

V 


1 2:30 

1 3:00 — 






X 

X 
X 


^ 


X 
X 
X 

X 


X 
X 

J ^ 

X 

BUS 














X 

— 


3:30 


y: 

X 






\ 

1 

1 

I 


V 

jX 


PRE 

. X 
X 










j 

X 
X 






1 4:00 — 


X 
X 






1 


X 
X 


X 
X 










^ X 
X 








X 








X 


X 
















4:30 

HOURS 


CO 
00 

• 




rH 
• 




o 
o 

• 

in 


o 
o 

• 






m 

00 


rH 
• 



63 



TABLE 7 

TECHNIQUES, CONTENT i AND VISUAL AIDS (FIFTH DAY) 
AS RECORDED BY PARTICIPANT OBSERVER 
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TABLE 8 

INSTRUCTORS' KNOWLEDGE OF SUBJECT AS RECORDED BY 
PARTICIPANT OBSERVER 

(1) 



Instructor 


A 


B 


c 


D 
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Yes No 


Yes No 
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TABLE 9 

INSTRUCtORS' KNdl^LEDGE OF SUBJECT AS RECORDED BY 
PARTICIPANT OBSERVER 



Insfructor 
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Total 


Enlcrprisc Knowlcdp,c 
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EPA Relalionship lo: 
States - 


1 




1' 


\ 1 








(, 


ll 








MiiniVinnlit ic^ — 

IVJ till l^jpUlJ IlVd 




















1 








Private' Enterprises 


1 




1 




1 1 




1 


LJnivcrsilics — 


1 




1 






1 1 






Other 








1 


1 














Job Kjiowledge 












Ix 




X 




X 






5 


1 


1 






Difficulties and 
Emergencies 
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X 






X 








X 


4, 2 


1 






Performance Standards 


X 


X 


t 

1 




X 


4 111 




Job Skills 










Lraits 
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TABLE ,10. ^ ■ . ♦ 
INSTRUCTORS' TRANSFER ABILITY' (1) AS RECORDED BY 

PARTICIPANT OBSERVER . 66 



Inslniclor — 


A 


B 


c 


D 




Yes No 


Yes Ni) 


Yes No 


Yes No 


Pnfnii^iinirntion .Skills 


5|4|3|:i 1 


5|4|3|2| 1 


5|4|3|2|1 


5|4|3|2|l 












Explanation 
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X 
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1 1 


Questioning 




xl 
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1 1 
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f» ■ — ' • ' ■ ■ 




I 


1 


1 




111 1 
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Visuals 
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Handouts 
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l>K\/ti7**^i11v Fit 

1 ny siCiUiy r u 
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X 






X 




X 




Emotionally Stable 


X 








X 








X 






X 




Poised 


X 








X 






X 




X 




Self Confident 


X 














|x 


1 




X 








X 


1 


Patient 


X 










J 1 






X 




1 1 


X 


1 1 


Understanding 










L 




1 




X 






X 






1 


Open-minded 










X 




1 


1 


Enjoy Working 


X 








X 




X 








X 






f'air 














X 


























X 














Ability to Motivate 












X 




X 








Ability to Quide 


X 








X 




X 






A 




1 


Ability to Counsel 




1 
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TABLE 11 

- INSTRUCTORS' TRANSFER ABILITY (2) AS RECORDED -BY 67 
PARTICIPANT OBSERVER 



Instrucior — 5^:^ 


E 






Total 




Yes No 


Yes No 


Yes No 


Yes M) 


^rkmnii 1 nif*n f ton ^LtiIIq 


5|4|3|2I I 


5|4|3|2| 1 


5|4|3|2|1 
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Explanation 


X 
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X 




A 2 


ii I- 


Questioning 
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ih 1 


Illustrating 
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A 1 
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a] 2 
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Written 










Lesson riajis 


X 










X 
















X 




6 




1 


Charts 








1 


















1 


Visuals 




X 








i\- 


















3 2I l| 


1 


Handouts 








1 
















III 


Tests 




















1 


!♦ 


It ldUMiU V/UiUl lit a 










Inlcllif.cnce 


X 












1 






1 




1 




6 


i 






rnysicaiiy ru 


X 














UN 




4 1 


2 1 


Emolioniilly Stable 


X 




















1 




1 




4 3 




Poised 


X 








X 








1 




5 1 1 


Self Confident 




X 








X 










IJ 




4 1 2 




Patient 


X 














1 1 






Understanding 






X 










1 


2 


2 1 






Open-minded 














\ 


1 1 


1 


1 1 


Enjoy Working 




X 




X 








1 


1 1 


1 




1 


1 


Fair 








X 






III 


1 


1 


1 




cuncdi 






X 








t 


1 


1 


1 


2 






Ability to Motivate 










X 








X 


'i 










Ability to Guide 










X 








X 








Ability to Counsel ^ 












X 












X 




1 


1 
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Table 12 shows the participant observer's evalua- 
tion of eight 'measurements of hedonic tone as factors 
affecting the morale of the students. 

Table 13 shows the participant observer's evalua*- 
tion of the physical facilities in which the training 
course was conducted ♦ 
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TABLE 12 

MORALE AS RECORDED BY PARTI CI PAMT OBSERVER 

69 



RFFECTIVitNiiSS 




INEFFECTIVENESS 




5 


4 


3 


2 


1 




SOLIDARITY - 
(unity of opinion, 
feeling, or 
interest) 




X 








withdraVing 


RAISING ESTEEM - 
(liigii regard, 
or respect) 




X 








DEFLATING ESI EEM 


GIVING HELP - 
(aid or assistance) 




X 






> 


WITHHOLDING HELP 


SATISFACTION - 
(gratification, 
pleasure, or 
contentment) 




X 








DISSATISFACTION 


AGREEMENT- 
(of same opinion 
or understanding; 
accord in feeling, 
action, or ideas) 




X 








DISAGREEMENT 


COMPLIANCE - 
(giving in to 
request, wish, 
or demand) 




X 








NON-COMPLIANCE 
• / 


OFFERING - ^ 
(unsolicited 
contribution lo 
^ classrocjfm 
activities) 


\ 


X 








ANTAGONISM 


INTEREST • 
(inlcnlncss, 
concern, or 
'curiosity) 




X 








DISlNTFRliST 
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V. 

I 

t 

TABLE 13 

PHYSICAL FACILITIES, AS RECORDED BY PARTICIPANT OBSERVER 

SPACE PER STUDEN T 2 persons per table-^very adequate 

FURNITURE AND EQUIPMENT table and chair — very comfortable 

SAFET Y No problems - 

' ■ ^- 

LIGHTING Excellent 



VENTILATI ON Exce 1 len t 



HEATING AND A/ C Cold first iday — reported — corrected 



SOUNDPROOFING FROM OUTSIDE NOISE S Completely 



ACOUSTICS Excellent 



PAINTING AND OTHER DECORATIONS bright and cheerful—environmental 
pictures ^ 

COAT RACK S None first morning — portable one jLarge enough brought^ 
in by 10 a.m. ^ . 

"^kp^^l A Small but adequ ate 



DRINKING FOUNTAIN within 100' 



WASHING AND TOILET FACILITIES within 150' 



HOUSEKEEPIN G Good — Room cleaned every day 



SERVICES PROVIDED FOR SLEEPING ACCOMMODATIONS, FLIGHT CONFIRMATIONS, 

TRANSPORTATION, EVENING ACTIVITIES, ETC. Flight confirmation 

provided _ 
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Subject Matter Test Sununary* ^ 

Figure 2 presents a profile of scores, on the 
.subject matter pretest and post- test, for each of the 
thirty-'four students who took both tests. The subject 
matter test is included as Appendix F; the key for 
scoring the test is included as V^ppendix 

The profile shows that the lowest growth in 
correct answers occurred with student N who had a -1 
answer growth. The student scored ten points in the 
pretest and nine points in the post-test. 

The profile shows that the highest growth in 
correct answers occurred with student V who had a +17 
point growth. The student scored twelve points in the 
^pretest and twenty-nine points in thQ post-test. 
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CHAPTER V 



ANALYSIS' OF DATA 



^ This chapter contains an Analysis' of the course 

accbrding -ip selected Variables* and. an analysis of growth 

■ ■* 

in learning ac6arding to change in ^SQOjre on items test^dr, . 
The' data- siammarie^s , wh^^ch were presented in Chapter 4, ' 
/provided the data baselitie foi^ the, analysis, ' 
Eleven variables Were selected as those which would 

potentially affect the , course effectiveness.' These are 

« . "* 

analyzed in '%his chapter andr the^ Researcher ' si^findings 

are establishecj for each variable. To. facilitate the . 

analysis and the presenta^-feLon of findings the data gathered 

fi;om. the study questionnaire and' the participant ot?server 

are pre^sented according to the particular variable to 

which they relate. The variables which were selected ^for 

analysis and *the establishment of f indiTfigg are : 

.s ' / ■ * ; ; „ 

Variable A: Subject matter .appropriateness to jo^ 

^ Variabie B: Teaching techniques 

. Variable C:' /Length of coui^se . ^ 

Variable ^ Seiquencirig of subject matter 

Variable E: Pace or prog?ress of course ^ 

. Variable F.:-?"^^eoretical or practical content. 
Variable G: I>nstructors ' ^knowled^e . *^ . 

Variable IJ: - Instructors ''"'Ttr^^ ability 

Variable I: PhysicaJL' faGllitie^ 

Variable Jt Visual* aids ^ 

Variable K: Morale''^ ^ 
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For purposes^ of njeasuring growth in subject matter 

(' J, 
items the findings resulted from: , 

1. An. item count to jneasure growth for each 

' of the test qy^stions. , . 

^2. A determination as to how nvuch growth ^as 

realized in each of the course subject 

'^^ matter topics, ' ^ 

3, The students' assessments of the extent to 

which they extended their -knowledge of waste- 

5j/ater /treatment technology as reflected in 

their answers to question 6 of the student 

questionnaire. 



Analysis of Course Effectiveness According to Selected 
Variables 

Variable A: Subject Matter Appropriateness to Job 

As revealed in student .questionnaire (question 5) 
set forth in Tables 14, 15/ and 16, 

TABLE 14 4 



SUBJECT MATTER APPROPRIATENESS TO JOB, STUDENT 



.RESPONSES TO QUESTIONNAIRE 



CHOICE. ^ FREQUENCY 



"84 




- 4 12. !■ 

16 48.6 
10 30.3 



3 • ' 9.0 

"^^33 ^^r*^''""i^olT 
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* . TABLE 15 

- SUBJECT MATTER. APPROPRIATENESS TO ; JOB' BY JOB 
TifPE OF RESPONDENTS TO STUDENT QUESTIONNAIRE 



Exactly Much Fairly So Llttlg Not -af All 



Administrator i county 

I planner ' i 1 

jlPlant operator 1 1 

.'Engineer ^ 4 
'Chemist, biologist, . 
microbiologist, 
environmental 

scientist ^ 2 2 ' 1 - 

Environmentalist, 
environmental 
^ specialist 4 
Auditor '2 5 1 

Technician 1 Jl 3 2_ 

Total •(N=33)^ 4 16 10 - 3 



' * TABLE 16 V 

SUBJECT MATTER APPROPRIATENESS TO JOB, BY^hSDUCATION OF 
RESPONDENTS TO STUDENT QUESTIONNAIRE 



Exactly Much Fairly So Little Not at All 



High school graduate 1 1 

Some college ^ 1 ' 3 2 1 

Bachelor degree 2 9 7 2 

Masters degree 4 



f 



16 10 



Personal comment given on question 19 of student 

questionnaire. 

1. Plant Operator — Since I am with *a 

chefnical plant I could h^ve used a little 
more information on industrial waste 
although I realize- each plant is ah 
individual case.., 
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^ - ; Findings, Variable A; All of the students felt 

that the subject matter of the course was to some 
degree appropriate to their jobs. Of these 
approximately ^ix€y percent felt that the subject 
matter was extremely appropriate. Thq data . 
indicate that the course was more appropriate to 
plant- operators, engineers, environmentalis ts , and 
• scientists than it wa§ to administrators, auditors, <^ 
and technicians. 

Variable B: Teaching Techniques 

As revealed on student questionnaire (question' 9) 
set forth in Table^ IT, 18 , 19 , 20 , 21, ' 22 , 23, 
24 and 25. ' - ' . 

TABLE 17 

TEACHING TECHNIQUES, STUDENT RESPONSES TO QUESTIONNAIRE, 





Lecture 


Discussion 


Demonstration 


Problem 


Seminar 


Choice 


Freq. 




Freq 


% 


Freq. 


% 


Freq . 


7. 


£' 

Much More 


0 


a 


1 


3.0 


4 


12.1 


3 


9.0 


More 


1 


3.0 


9 


27.3 


15 


45.5 


15 


45.5 


About right 


21 


63.7 


21 


63.7 


14 


42.4 


15 


45.5 


Less 


11 


33.3 


• 2 


6.0 


0 


0 


0 


0 


Much less 


0 


' 0 


1 0 


0 


0 


0' 


0 


0 


Total 


33 


100.0 


• 33 


100.0 


33 


100.0 


33 


■ 100.0 
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TABLE 18 

TEACHING TECHNIQUES—LECTURE, BY JOB TYPE OF 
RESPONDENTS TO STUDENT QUESTIONNAIRE 



Much About 
Mere; More Right 



Less 



Much 
Less" 



Administrator , county 

planner 
Plant operator 
Engineer 

Chemist, biologist, 

microbiologists, 

envlronmejital scientist 
Environmentalist , environ- 
, mentaX specialist 
Auditor 
Technician 

Total (N=33) 



2 
3 



21 



1 



1 
3 
3 



11 



TABLE 19 

TEACHING ^Techniques—lecture, by education of. ' 

RESPONDENTS TO STUDENT QUESTIONNAIRE 





Jiuch 




About 




Much 




More 


More 


Rip.ht 


Less 


Less 


High school gracluate 






1 


1 




Some college 






5 


2 




Bachelors degree 






12 


8 




Masters degree 




1 


3 






Total (N=33) 




1 


21 


11 





8 



TABLE 20 

TEACHING TECHNIQUES— DISCUSSION, BY JOB:TYPE OF 
.EESPONDENTS TO STUDENT QUESTIONNAIRE 







Much 
More 


More 


About 
Right 


Much 
Less . Less 


Administrator, 
planner 


county 






2 





"^Plant operator T 
Engineer 4 
Chemist, biologist, 
microbiologist, 

environmental scientist 1 2 2 

Environmentalist, environ- 
mental specialist 13 
Auditor^ ^ ^ 2 4 



Technician ' 4 4 



Total (1^33) 1 9 21 



TABLE 21 

TEACHING TECHNIQUES—DISCUSSION, BY EDUCATION OF 
RESPONDENTS TO STUDENT QUESTIONNAIRE 





Much 




About . 


Much 




More 


More 


Riftht 


Less Less 


High- school graduate 




1 


1 




Some college 




3 


4 




Bachelors degree 


1 


5 


12 


2 


Masters degree 






4 





Total (N=33) 1 9 21 2 
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TABLE 22 

TEACHING TECHNIQUES— DEMONSTRATION, BY JOB TYPE OF 
RESPONDENTS TO STUDENT QUESTIONNAIRE 





Mucli 




Ab out 




Much 




More 


More 


Right 


Less 


Less • 


Administrator, county 






f 






planner 




1 


1 






Plant operator 




1 


1 






Engineer 






4 






Chemls t , blologls t , 












microbiologist , 












environmental scientist 


2 


1 


2 






Environmentalist , environ- 












mental specialist 




3 


1 






Auditor 


1 


5 


2 






Technician 


<• 1 


4 


3 






Total (N==33) 


4 ' 


15 


14 







TABLE 23 

TEACHING TECHNIQU{:S~DEMONSTRATIONy BY EDUCATION OF 
RESPONDENTS TO STODENT -QIJeSTIONNAIRE 



1 




Much 




About 




Mi\ch 






More 


More 


Right 


Less 


,Les8 


High school graduate 






1 


1 


■J " 




Some^ollege 


-J 


1 


3- 


3 






Bachelors degree 




3 


10 


■7 






Masters degree 






1 


3 






Total (N=33) 




4 


15 


14 
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TABLE 2A ' 

TEACHING TECHNIQUES—PROBLEM SEMINAR, BY JOB TYPE OF 
RESPONDENTS TO STUDENT QUESTIONNAIRE 





Much 




About 




Much 




More 


More 


Right 


Less . 


Less 


Administrator , county 












planner 




• 1 


1 






Plant operator 






2 






Engineer 


2 


2 






Chemist, biologist, 












microbiologist. 












"envlxonmental scientist 


1 


2 


2 






Environmentalist , environ-? 


'l 










mental specialist 


1 


1 


- 2 






Auditor 




4 


4 






Technician 


1 


5 


2 






Total (N=33) 


-3 


15 


15 







TABLE 25 

TEACHING TECIInIQUES— PROBLEM SEMINAR, BY EDUCATION OF 
RESPONDENTS TO STUDENT QUESTIONNAIRE* 





Much 




About 


Much • 




More 


More 


RiKht 


Less' Less . 


High school graduate 




1 


1 




Some college 


1 


2 


4 




Bachelors degree 


2 


10 


8 




Masters degree 




2 


2 




Total (N=33) 


3 


15 


15 
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Personal coiranents given on question. 19 of student 
questionnaire. 

1. Chemist — Overall the course was very ^ 
well performed but there should be 
more student participation. 

2. Auditor — There was too little involve- 
ment oi the class in a give and take 
mode. 

3. Biologist — More discussion concerning 
the facilities to be visited ahead of 

; time, would enable students to better 
- understand the facilities. 

4. Environmentalist — Concerning the field 
trips — I thought more of^ a briefing on 
the types of plants should have been 
given. I would have liked to have seen 
an advanced treatment facility t^ecause 

I feel this area is the least understood 
for the beginning student. 

5. Engineer — At two of the three treatment 
plants visited, it was extremely difficult 
to get close enough to the instructor or 
treatment plant operator to get ar^ infor- 
mation on the operation of the plant. 

6. Auditor--The plant visits are good in ^ 
concept but utterly lacking in a practical ^ 
sense. They appeared to be poorly 
organized and we got little out of them, 
since there v;as no organized attempt to 
tell the grcHjp about the plant operation 

or to follow a specific flow. ' It was 
almost impossible to hear any of the 
comments on plant operation unless you 
were next to the speaker. In a group of 
thirty five this is impossible fpr every 
one. I believe it would be a good idea 
to brief the group prior to the plant 
visits, to prepare flow charts, and to 
discuss the aspects of the plant . By so 
doing the people will know what thay are • 
looking at and just where it fits in to 
the plant operation . 
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As reported by participant observer. 



Teaching Technique Course — Hours 

Lecture 20# 50 

Discussion . 66 

Demonstration' (Plant Visits) 4.17 
Problem Seminar ^67 



Total 2*6.00 

Comments by participant observer. 

1. Slides were used almost continuously. 

2. All lectures were sight and sound. 

3. All quesJn.ons on lecture theory were 
answeredr promptly and expertly. Some 
questions , Mealing with practical back 
home nefeciSr were hedged. 

» 

4. The plant visits .were not near as fruitful 
as they might have been. There should 
have been a briefing , prior to the 
visits, in which the plant operations 
were described, by use of flow charts, 

and the plant capacities given. The 
class should have been divided into 
small groups, for the tours, so that all 
students could hear the guides and see 
the process being described. 

Findings, Variable B: Approximately thirty four 
percent of the students felt that there should be 
less lecture while approximately 55 percent fel^^t 
that there should be more problem seminars and 
approximately 58 percent felt that there should be 
more demonstrations. Students of all. job types 
and level of education were reasonably uniform 
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in their choices. Comments by both students and 
participant observer strongly suggest that to 
increase effectiveness of plant visits, an 
introductory si^^slbji is necessary. This would 
include plr^nt descriptions, plant capacities, flow 
diagrams, etc. Also, it was suggested that the 
tour groups be made smaller so that all students 
would be able to^^se^ the equipment, hear the guide, 
and ask ques^:ioris when appropriate. 

Variable C: Length of Course 

As revealed on student questionnaire (question 10) 
set forth in Tables 26, 27 and 28. ^ 



TABLE 26 

LENGTH OF COURSE, STUDENT RESPONSES TQ QUESTIONNAIRJi; 



CHOICE FREQUENCY (f) 



Much too long 0 0 

A little too long 6 18.1 ( 

About right 20 .60.6 1 

A little too short 1 21.3 

Much too short ^ 0 0 

Total 33 100.0 . 
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TABLE 27 

LENGTH OF COURSE BY JOB TYPE OF 
RESPONDENTS TO STUDENT QUESTIONMIRE 



nucn ioo 


A T n t- 1- 1 Q 


Adou l 


A T ^ r r 1 o 


Mtirh Ton 


Long 


Too Long 


Right 


loo bnorc 


bnor t 


Administrator, 










county planner 


1 




1 




Plant operator 




2 






Engineer 




2 


2 




Chemist , biologist , 










microbiologist, 










environnental 










scientist 




A 


1 




Environmentalist , 










environmental 










specialist 




3 


1 




Auditor 


2 


6 






Technician 


^ 3 


3 


2- 




Total (N-33) 


6 


20 


7 





TABLE 28 



LENGTIi OF COURSE BY EDUCATION OF 
RESPONDENTS TO STUDENT QUE]|:^^^AIRE 



f^j. Much Tpor' A Little ASout A Little Much Too 

• ^ Lon^ Too Long Rip3ht Too Short Short 

High school graduate . .,/^ n 2 

Some college ";^./^ 1 A 2 

Bachelors degree M ^' H * 

Masters degree 1 3 1 

Total (N=33) 6 20 7 
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Findings, Variable C: Approximately sixty one 
percent of the students felt that the length of 

r 

the course Wqis about right. Approximately eighteen 
percent felt that it was a little too long and 
twenty one percent felt that it was a little too 
short. There was no significant differences in 
the choices of students by job types or levels 
of education. 

Variable D: Sequencing of Subject Matter 

. As revealed on student questionnaire (question 13) 
set forth in Tables 29, 30 and 31. 

TABLE 29 

SEQUENCING OF SUBJECT MATTER, STUDENT RESPONSES TO QUESTIONNAIRE 



CHOICE 


FREQUENCY (f) 


% 


Excellent 


0 


0 


Very good 


. 10 


30.3 


Good 


. 13 


39. A 


Fair 


10 


30.3 


Poor 


0 


0 


Total 


33 


lOff.O 
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TABLE 30 



SEQUENCINGvOF SUBJECT MATTER BY JOB TYPE OF RESPONDENTS TO 

STUDENT QUESTIONNAIRE 



Excellent Very G^d Good> Fair Poor 



^Administrator, 

county planner 
Plant operator 
^^er 

./Biologist, 
Fobiologis t , 
Lronmental 
scientist 
Environmentalist , 
environmental . 
specialist 
Auditor 

Technician ^ 
Total (N=^33) 




7 



2 
4 
3 



1 
2 
3 



10 



13 



10 



TABLE 31 

SEQUENCING OF SUBJECT MATTER BY EDUCATION OF 
RESPONDENTS TO STUDENT QUESTIONNAIRE 





Excellent Ver_y Good 


Good 


Falr__ 


High school graduate 


1 




1 


Some college 


2 


it 


1 


Bachelors degree 


5 ^ 


. 9. 


6 


Masters degree 


2 




2 


Total (N=33) 




13 


10 



- '.'ft 
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As reported by participaat observer, 



; TABLE 32 

SEQUENCING OF SUBJECT MATTER AS RECORDED BY 
PARTICIPANT OBSERVER 



f ' 

SUBJECT MATTER TOPIC ■ SEQUENCE 



Nature of objectionable materials to be treated 1,13 

The law and NFDES ' ' 2 

Measurement and testing requirements 3,11 

' Aquatic life and the streaip . , 4 

Overview of wastewater treatment . . 5 

Unit operations . in wastewater treatment^ 6 

Bacteriological data and coliform 7,25 

Disinfection of treated discharges ^ - 8,24 

The law and NPDES ^ ' . . ^ * 

Physical and chemical test 10* 

Sampling for tests and measurements ' 12 

Collection system considerations 14 

Screening, grit removal, and grinding " • 15 

Wastewater pumping / 16 

Flow distribution and control 17 

Clarification and sedimentation ' 18 

Activated sludge treatment • . V) 

Trickling filtration treatment ' 20 

Oxidation ponds ^ ' 21 

Phusical/Chemical treatment: 22 

Treatment planjt toUr and discussion 23 

Sludge dewatering operations ' , , / i 26 

Incineration of solids • , • 27 

Land disposal of sludge yith liquids - ^28 

Anaerobic digestion 29 

^ Safety • ' ' 30 ^ 



Findings, Variable D: All of the students felt that 
the sequencing of subject mat'ter was fair to very 
good. The students whose jobs are more scientific 
or more technical rate the sequencing of subject 
matter slightly higher than the students whose jobs 
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are les^s scientific or less technical. Participant 
observer felt that the sequencing of the subject 
matter was good. 

Varig^ble E — Pace or Progress of Course 

As revealed on student questionnaire (question 12) 
.set forth in Tables 33, 34 and 35. 



TABLE 33 

PACE OR PROGRESS OF COURSE, STUDENT 
RESPONSES TO QUESTIONNAIRE 



CHOICE FREQUENCY (f) 



Much too fast Q 0 

A little too fast 4 12-.I 

About right 18 54.6 

A little too slow 10 30.3 

Much too slow 1 3.0 

Total 33 100.0 
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TABLE 34 



PACE OR PROGRESS OF COURSE BY JOB TYPE ojp 
RESPONDENTS TO STUDENT QUESTIONNAIRE 



f 


Much Too 


A little 


About 


A Little Much Too 




Fast 


Too Fast 


Right 


Too Slow Slow 


Administrator, 










county planner 






1 


1 


Plant operator 






2 




Engineer 






3 


1 


Chemist, biologisj^. 










microbiologist. 










environmental 






• * 




scientist 






3 


2 


Environmentalist, 










environmental 










specialist 




1 


2 


1 


Auditor 




1 


6 


1 


Technician 




2 


1 


4 1 . 


Total (N=33) 


r 


4 


18 


10 .1 



\ 

TABLE 35 

PACE OR PROGRESS OF COURSE BY EDUCATION OF 
RESPONDENTS TO STUDENT QUESTIONNAIRE 





Much Too 


A Little 


About 


A Little 


Much Too " 




Fast 


Too Fast 


Right 


Too Slow 


Slow 


High school graduate 






2 






Some college 




2 


3 


2 


• 


Bachelors degree 




2 


10 


7 


1 


Masters degree 






3 


1 




Total (N=33) 




4 


18 


10 


1 



90 



Personal comments given ^n questionnaire X9. 

1. Auditor — Sessions were too long-^-without 
breaks. 

2. Auditor — Could "have had less breaks and 
longer lunch period. 

Findings, Variable E: .Approximately 55 percent of 

the students ^felt thgit the pace or progress of the 

.course is about right and approximately 30 percent 

of the students fejifc t^^ it was too slow* The only 

students who felt- tlt^fc^ too fast are employed 

in the job"" categories -of environmentalist, auditoXf 

and technician. 



Variable F: Theoretical' or Practical Content 

As revealed on student questionnaire (question 11) 
set forth in Tables 36, 37 and 38. 

TABLE 36 . . ' 

, THEORETICAL OR PRACTICAL CONTENT, STUDENT 
^ RESPONSES TO QUESTIONNAIRE 



CHOICE FREQUENCY (f) % 



Lot more theoretical 


0 


0 


Little more theoretical 


1 


3.0 


About right 


15 


' 45.5 


Little ippre practical 


15 


45.5 


Lot more practical 


2 


6.0 


. Total 


33 


. 100.0 



" 100 



o 
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TABLE 37 

THEORETICAL OR PRACTICAL CONTENT BY JOB TYPE OF 
RESPONDENTS -TO STUDENT QUESTIONNAlTlE 



/A 




Lot More 


Little More 


About 


Little More 


Lot More 




Theoretical 


Theoretical 


Right 


Practical 


Practical 


Administrator, 










r 


county planner 






2 






Plant operator 






1 


1 




Engineer 






3 


1 




Chemis t , biologist , 












microbiologist , 












environmental 












scientist 




1 


' 3 




1 


Environmentalist, 












environmental 












specialist 






1 


3 




Auditor 






1 


6 


1 


Technician 








A 




Total (N=33) 




1 


15 


15 


2 



TABLE 38 

THEORETICAL OR PRACTICAL CONTENT BY EDUCATIOli oV 
RESPONDENTS TO STUDENT QUESTIONNAIRE ' 



' Lot More Little More About Little more Lot More 
Theoretical Theoretical Right Practical Practical 



High school graduate 




1 


1 




Some college 




3 


4 




Bachelors degree;' 


1 


8 


9 


2 


Masters degree 




3 


1 - 




Total (N=33) 


1 


15 


15 


2 
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Student questionnaire — personal coiranents given on 
question 19. > 

1 . Environmental Specialist — Not enough 
time spent on operation problems and 
solutions and how to improve existing 
plants. 

2. Administrator — To really teach more 
about operation, the course should be 
made more specific 4nd practical in 
application. 

3. Technician — I think it could be 
advantageous to present special 
problems, e.g. , disposal of sludge, 
as well as solutions, to these kinds 
of problems, which h^ve been imple- 
mented by various cities. 

As reported by^. participant observer. 



COURSE HOURS % 


Theoretical 


6.83 - 


26.3 


Practical 


19.17 


73.7 


Total 


26.00 


100.0 



Findings, Variable F: Approximately 52 percent of 
the students felt that the course should be more 
practical. The participant observer indicated thaj 
approximately 75 percent of the course time was 
devoted to practical content, as defined for him 
by the researcher-. v • ( 
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Variable Gt Instructors' Knowledge 

As revealed oi> student . questionnaire (question 14) 
set forth in Tables 39, 40 and 41. 

TABLE 39 

INSTRUCTORS' KNOWLEDGE, STUDENT RESPONSES TO QUESTIONNAIRE 



CHOICE 


FREQUENCY 


% 


Excellent 




33; 3 ' 


-Very good 


15 


45.5 


Good 


5 


15.2 


Fair 


2 


6.0 


Poor 


0 


0 


Total 


33 


100.0 



TABLE AO 

INSTRUCTORS' KNOWLEDGE BY JOB TYPE OF 
RESPONDENTS TO STUDENT QUESTIONNAIRE. 



Excellent 



Very Good Good Fair Poor 



Administrator, 

cownty planner 
Plant operator 
Engineer 

Chemiot, Biologist 
microbiologist , 
environmental * 
scientist 

Environmentalist, 
environmental 
specialist 

Auditor 

Technician 
Total (NiOa) 



1 

3 
4 



11 



3 
2 



15 



1 

2 



5 • 




TABLE Al 



INSTRUCTORS' KNOWLEDGE B?| EDUCATION OF 
RESPONDENTS TO STUDENT '^jlJESTIONNAIRE 



Excell6nt Very Good . Good Fair Poor 



High school graduate 1 
Some college 5 
Bachelors degree 4 

Masters degree 1_ 

Total (N=33) ' 11 



2 
12 
1 



2 

2 



15 



Personal conunents given on question 19 of student 
questionnaire. 

Ir. Environmental Specialist — Overall I got 
quite a bj.t out of the course and was 
impressed by the knowledge and background 
of the decturers. : 

2. Auditor — Some instr^tors were short on 
technical aspects of sev;age treatment 
because it was not their field. Hovyzever, 
the course director was excellent. ^ 

As reported by participant observer. 



TABLE 42 



INSTRUCTORS' 1CN0V7LEDGE AS RECORDED BY 
PARTICIPANT OBSERVER 





NUMBER 


POINT SCORE 




ATTRIBUTE • 


INSTRUCTORS 


5 4 3 2 1 


MFJ^N SCORE • 




RATED 


FREQUENCY 




Federal Legislation 


A 


2 11 


3.7 


EPA Organization 


3 


2 1 




Relationship to States 


1 


1 


5.0 


Relationship to 








municipalitHes 


1 


1 


' 5.0 






continued— 
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TABLE kl 












(Continued) 












NUMBER 


POINT SCORE 






ATTRIBUTE 


.INSTRUCTORS 


5 4 


3 2 1 


MEAN 


SCORE 




RATED 


FREQUENCY 






Rela t ionsh ip to private 












enterprises 


1 


1 




5 


.0 


History and background 


7 


5 


1 1 


4 


.7 


Difficulties and 












emergencies 


2 


1 


1 


4 


.0 


Standard operating 












procedures 


7 


4 


2 1 


4 


.4 


Standards of acceptable 












job performance 


7 


4 


111 


4 


.1 


Reference material 


7 


6 ■ 


1 


A 


.8 


Total 


40 


27 


6 5 1 


4 


.45 



Comment by participant observer. 

1. All lecturers were we-1 prepared and 
each was an expert in his field. 
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Findings, Variable G: Approximately 94 percent of 
the students felt that the instructors' knowledge 
of the subject was good to excellent. Participant ^ 
observer was in general agreement except for isolated 
instances reflected in his report, Table 42. In 
general , the students of higher education levels 
rated the instructors lower than did the students 
of lower education levels. 
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Variable H: Instructors' Transfer Ability 

As revealed on student questionnaire (question 15) 
set forth in Tables 43, 4 4 and 45^. ^ 
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TABLE 43 

IN 



JTRUCTORS' TRANSFER ABILITY, STUDENT 
RESPONSES TO QUESTIONNAIRE 



/ 



CHOICE . FREQUENCY % 



Excellent 


2 


6.0 


Very good 


9 


27.3 


Good 


16 


' 48.5 


Fair 


6 


18.2 


Poor 


0 


Q 


Total 


- 33 


100.0 



TABLE 44 

INSTRUCTORS' TRANSFER ABILITY BY JOB TYPE OF 
RESPONDENTS TO STUDENT QUESTIONNAIRE 







Excellent 


Very Good 


Good 


-> 

Fair 


Poor 


Administrator, 












county planner 








2 




Plant operator 


1 




1 






Enginaer 




1 


3 






Chemist , Biologist, 












microbiologist , 












environmental 












scientist 




3 


2 






Environmentalist , 












environmental 












specialist 




1 


3 






Auditor 


1 


1 


A 


2 




Technician 




3 


3 


2 




Total (N=-33) 


2 


0 ' 


16 


6 





iOG 
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TABLE 45 

INSTRUCTORS^ TRANSFER ABILITY BY EDUCATION OF 
RESPONDENTS TO STUDENT QUESTIONNAIRE 

Is- 



Excellent Very Good Good Fair Poor 



High school graduate 
Some college 
Bachelors degree 
Masters degree 
Total (N=33) 



3 



2 
11 
2 



16 



2 
3 
1 



X 



]^rsonal comments given on qt^estion 19 of student 

questionnaire. 

1. Auditor — Instructoifs generally used 500 
words (including many big ones which 
possible obscure meaning) where 50 
f ^ WQUld have been plenty. 
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2. Auditor — Some instructors spoke too 
rapidly and in a low voice — hot too 
effective. 

3. Technician — Some instructors werew^-lri.^^ 
prepared and had something to sa/; Others 
wasted our time. 

4. Technician — Some sessions were rather dull 
due to instructor's lack of enthusiasm. 

/Much too redundant in some cases. 

5. Auditor — Some repetition in lectures. 

6. Technician — Lectures were presented on a 
high school level with no challenge to 
more advanced students . 

7. Environmentalist — The lectures of two of 
the instructors tended to be too subject 
specific. The topics covered were 
appropriate to general discussion but 
detailed to general cases were r)Ot necessaryt 

8. Environmentalist — The lecture on Physical 

and Chemical Tost Review Criteria, which ^ p7 
could have bc^en complex, was presented in ^ ^> • 
a manner that anyone could understand. 

' O 
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9. Technician — Often it seemed that: the 

instructors were not reaching at a level 
appropriate to the group of students. 
Generally, the students ' questions indi- 

^ cated more of an advanced understanding 
Of wastewater treatment while the 
instructors presented a superficial 
orientation to the topic. 

10. Technician — Most of the instructors were 
very good and the course director did a 
great job. One of the instructors was 
inadequate. 

11. Auditor — The instructors were excellent 
except for one who read from a paper. 

12. Engineer — One of the' instructors , in my 
opinion presented the material very poorly. 

13. Technician — One instructor in particular, 
could profit by spending a little more 
time on personal hygiene. 

As reported by participant observer. 

TABLE A6 

INSTRUCTORS' TRAI^SFER ABILITY AS RECORDED BY 
PARTICIPANT OBSERVER 



NUMBER POINT SCORE 
ATTRIBUTES INSTRUCTORS 5 4 3 2 1 MEAN SCORE 
RATED ^ FREQUENCY 



Explanation 




4 2 1 


4.4 


Questioning 




3 13 


4.0 


Illustrating 




4 2 1 


4.4 


Lesson plans 




6 1 


4.6 


Visuals 




3 2 1 ■ 


4.3 


Intelligence 




6 1 


4.8 


Physical Pit 




4 12 


4.2 


Emotionally Stable 




4 3 


4.6 


Poised 




5 11 


4.6 


Self Confident 




4 12 


4.2 


Patient 


6 


6 


4.0 


Understanding 


5 


2 2 1 


4.2 


Open Minded 


2 


1 1 


. 4.0 


Enjoy working 


6 


4 1 1 


4.5 
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TABLE 4a * 








(Continued) 


Si 


> 

\ 




NUMBER 


^ ^ 

POINT SCORE 




AXTKOEBteES 


INSTRUCTORS V 


5 4 3 2 1 


MEAN SCORE 




RATED 


FREQUENCY 




Fair 


2 


2 


' 4.5 


Ethical 


2 


2 * 


5.0 


Ability to motivate 


4 


3 1 


4.2 


Ability to guide 


6 


4 11 


4.3 


Ability to counsel 


2 


1 1 


3.5 


Total 


104 


61 24 14 4 


4.37 



Findings^Variable H: Approximately. 82 percent 
of the students felt that the instructors' abiMty 
to transfer knowledge was good to excellent. Pt ' * 
was noted that in some cases the instructor (s) 
was inclined to be tod wordy, the sessions were 
dull, the mateial vzas preseKted at a lower than ''^^f 



acceptable level, and the conter^was, to some 
extent, redundant and superficial. One instifucto^^ - 
was singled out by students and participant \^ 
observer as having been inadequate. 
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Variable I: Physical Facilities 

As revealed on student questionnaire (question 16) 
set 'forth in Tables 47, 48 and 49. 

TABLE 47 

PHYSICAL FACILITIES, STUDENT RESPONSE TO QUESTIONNAIRE 



CHOICE 


FREQUENCY 


%. 


Excellent 


5 


15.2 


Very good 


19 


-57.6 


Good 


6 


18.2 


Fair 


2 


6.0 


Poor 


1 


i 3.0 


Total 


33 

1 


. 100. Q 



TABLE 48 



PUYSICAEf; FACILITIES K^^j^T^PE OF 
ICESPONDENTS to student QtnkSflONNAIRE 



Excellent 



Very Good Good Fair Poor 



Administrator, 

county planner 
Plant operator 
Engineer 

Chemist, Biologist, 
microbiologist , 
'environmental 
scientist 

Environmentalist 
environmental 
specialist 

Auditor 

Technician 

Total (N=33) ' 



• 2 



3 
7 
5 



19 



1 
1 
1 



1 
1 



1 
i 1 



1,10 
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TABLE 49 " 

PHYSICAL FACILITIES BY EDUCATION OF RESPONDENTS TO 
STUDENT QUESTJIONNAIRE 



Excellent Very Good Good Fair Poor 

High school graduate 1 1 

Some college 2 4 ^1 

Bachelors degree ^ 2 ' 13 4 1 

Masters degree ' 1 , 2 1 

Total (N=33) 5" 19 6 2 ^1 



As reported by participant observer. 

Space per student — 2 persons per table — 

very adequate 
Fui:niture and equipment — Very comfortable. 
Safety — No problems . 
Lighting —Excellent s 
Heating and A/C — Cold on Monday morning- 
reported it — corrected . 
soundproofing ffom outside noises — completely 
Acoustics^ -Excellent > • " 

Painting and other decorations — bright and 

cheerful — environmental pictures 
Coat Racks — None the first morning — portable 

one large enough brought in by 10:00 a.m. 
Cafeteria — small but adequate 
Drinking Fountain; — within 100 feet 
Washing and toilet f acilities --Within 150 feet 
' Housekeeping — Good, room clearted every isvening 
Services — provided for flight confirmation. 

Findings, Variable I: Approximately 91 percent of the 
students indicated that the facilities were good to ^ 
excellent V In general, students of the higher 
education level rated the physical facilities lower 
than did the students of lower education l^evels • 
The participant observer indicated that the 
facilities were very good. 

Ill ' ■ 



r 
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Variable J : Visual Aids 

As revealed on student questionnaire (question 17) 
set forth in Tables 50, 51 and 52. " 

TABLE 50 

^ VISUAL AIDS, STUDENT RESPONSES TO QUESTIONl^AIRE 



CHOICE FREQUENCY % 

■1 

Far too many 1 3.0 

Few too many 4 12.1 

Just right 27 ^ - 81.9 

Not quite enough 1 3.0 

n Far too few 0 0 

Total 33 100.0 



TABLE 51 

VISUAL AIDS BY JOB TYPE -OF RESPONDENTS TO 
STUDENT QUESTIONNAIRE 





Far Too 


Few Too 


Just 


Not Quite Far Too 




Many 


Many 


Right 


Enough Few. 


AdTninis t r a t or , 










" county planner 






2 




Plant operator 






2 




Engineer 






4 




Chemist , Biologist , 










microbiologist , 










environmental 










scientist 




1 






Environmentalist^ 










environmental 








* 


specialist 




1 


3 




Auditor 


1 


1 


6 




Technician 




1 


6 


1 


Total (N«33) 


1 


4 


27 


1 
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TABLE 52 

VISUAL AIDS BY EDUCATION OF RESPONDENTS TO 
STUDENT QUESTIONNAIRE 



-^irl — 










Far Too Few Too 


Just ^ 


Not Quite 


Fdr Too 


Many 


Many 


Right ' 


Enough 


Few 


Hi^h school graduate 




2 


i 




Some college 




6 


1 




Bachelors degree 1 


3 


16 






Masters degree 


1 


3 






Total (N=33) 1 


4 


27 


1 




Personal ' corpaents 


given on 


question 


19 of student 



questionnaire. 



1. Auditor — Although the vis-ual aids were 
generally good, there were too many 
segments using an uninterrupted flow 
of visuals. In addition, there was 
•'too little imagination used in the 
preparation of the visuals • Flow/ for 
instance, can be graphically shown on a 
projection by using polarized light to* 
cause an actual flow through the visual. 
In addition a movie of plant operations 
would have been helpful. 

Environmental Specialist — 'Some visual aids, 
es£t)ecially overhead projection aids, 
tended to be of ^little use,. This was not 
true of slides and schematics, however. 

Auditor — The continued use of visuals, ' • 
together with ilhe lack of student 
participation, caused a frequent-^loss of 
attention. 

Technician — Insufficient use of videotape, 
but ext!ellent use of s'lides. 

Auditor-y-Some visual aids (slides — which 
presumably contained important information) . 
were not left visable long enough. 



3. 
4. 

5. « 
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As reportefl by participant observer ' 
Of the twenW-six course hours, visual aids 
were utilizer for approximately 23.5 hours. 
They. Were considered Very ,good but continuous 
use tended to di^scourage questions from 
students and mad^ the course appeal "canned" 
without flexibility to meet individual needs. 
Findings, Variable J:l Approximately 82 percent of 
the students felt that the utilization of visual 

Approximately 15 percent of 



aids was just right, 

the students "felt that\ th^re were too many visual 

aids used because it tandeJi to discourage student 

\ 

participation and caused5:^^laCk of attention to subi.ect 
matter*: All st\;fedents offering commejits relative to 
this were those of higher education levels. 

» 

Variable K: Morale 

As revealed on student questionnaire (question 18) 
set forth in Tables 53, 54 and 55. 

TABLE 53 

MORALE, STUDENT RESPONSES TO QUESTIONNAIRE 



ERIC 



CHOICE 


FREQUENCY 


% 


Excellent 


2 


6.0 


Very good 


17 . 


51.7 


Good A 


11 


33.3 


Fair \ 


3^ 


9.0' 


Poor 


0 


0 


Total 


33 


100.0 
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TABLE 54 

\ MORALE BY JOB TYPE OF RESPONDENTS TO STUDENT QUESTIONNAIRE 



.k't 



Administrator, 

county planner 
Plant operator 
Engineer 

Chemist, Biologist, 
microbiologist, _ 
environmental 
scientist 
Environmentalist , 
environmental 
specialist 
Auditor 
Technician 
Total (N=33) 



Excellent Very Good Good F air Poor 

1 



1 
3 



2 
6 
2 



17 



1 
1 



2 
1 
4 



11 



1 
1 



TABLE 55 

MORALE BY EDUCATION OF RESPONDENTS TO STUDENT QUESTIONNAIRE 



<» 




Excellent 


Very Good 


Good 


Fair 


Poor 


High school graduate 
Some college 
Bachelors degree 
Masters degree 
Total (N=33) 


1 . 
1 


A 
12 
■ 1 


2 
6 
3 


1 
2 


- i 


2 


17 


11 


3 





11?) 
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As reported by the participant observer. 

Q 

1. In general, the moxale of the students 
appeared to "^be very good. However, im 
attempting to rheasur-e hedonic tone factors, 
I was unable to give the maximum points 
to any ^ the factors. Each factor seemed 
to approach full effectiveness but subtle 
influences affected them. Morale which 
had been high at the beginning of the 
course declined by mid-week, and had risen 
again by the end of the course. 



Findings,,. V|Lri^ble K: Approximately 91 percent of 
the students felt that morale was good to excellent. 
Although morale in. general appeared to be high, there 
were factors which caused morale to decline, during 
the course, and then to rise by the time the course 
ended. The jrange of choices selected was largest 
for auditors and technicians. 



Analysis of Growth in Learning on Items Tested 

As previously stated^^ for purposes of measuring 
growth, J;he same subject matter test was used for pretest 
and post-test. The subject matter test included a total 
of sixteen questions containing thirty-five items. Thirty- 
four students took both the pretest and post-test. The 
ba^ic data base for this analysis consisted of: 1) the 
scores of the pretests and post- tests, and 2> the students' 
responses to question 6 of the questionnaire. ' A copy of 
the subject matter test is included as Appendix G. 



IIG 
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Analys.is of Test Questions 



For each test 


question a 


determination was made of 


the .number of students scoring 


the satne, 


higher , or lower 


on the post-test. 


The results 


are shown 


in Table 56. 




TABLE 56 






* ^ SUBJECT MATTER TEST, 

0 


ITEM COUNT 






' Number of Students With: 


Subject Matter 


Pretest and 






Test Question 


Post-Test 


Post^Test 


Post-Test ^ 


Number 


Same 


Higher 


Lower 


1 


10 


21 


3 


.2 


29 


3 


2 


3 


10 


21 


3 


4 


25 


5 


4 


5 


26 




4 


6 


32 


2 


0 


7 


23 


9 


2 


8 


27 


7 


0 


9 


' 29 


3 


2 


10 


26 




4 


11 


31 


3 


0 


12 


26. , 


3 


5 


13 


7 


24 


3 


14 


17 


17 


0 


15 


33 


0 


1 


16 


19 

J" 


13 


2 



From further analysis of the data it was apparent 



that at least 20 percent of the students showed growth in 
knowledge 4.n each of test questions 1,3,7,8,13,14, and 16. 
These questions are shown in Table 57 in rank order of 
subject matter improvement. In addition, the right hand 
column lists those subject matter topics which were tested-, 
by the subject matter test questions. 

HI. 
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TABLE 57 



SUBJECT MATTER TEST QUESTIONS 
AND SUBJECT MATTER TOPICS HAVING 
MOST GROWTH IN CORRECT RESPONSES 



Question Number 



t 

Nxunber of Post-Tests 
Indicating Growth 



Subject Matter 
Topic 




13 
1 
3 
14 
16 
7 
8 



24 
21 
21 
17 
13 
9 
7 



X 



6 c,d,e,&f 

1 

2 

6 c,d,e,&f 
6 g 
4 a 
A b 




The stibject matter topics showing growlsh in Table 57 



are listed below in the same order as shown in ^ the Table. 

Preliminary treatment operations 
Primary treatment oper'ations 
Secondary treatment operations 
Physical chemical treatment 
^ Characteristics of wastevfeter 

Status — NPDES 

Sludge handling and disposal 
Signf icance of bacteriological data 
Exarair>ation of water for colifortn and fecal 
coliform groups 

Of the subject matter topics tested least growth 

was indicated for the following subject matter topics: 



The aquatic environment 

The effects of pollution on the aquatic 

envirpnment 
Physical and chemical test criteria review 
NPDES self-monitoring tests 
Process control testing ^, - * 

♦Sampling water flows 



1 18 



t 

109 

Analysis of Students' Findings 

' Table 58 is a frequency distribution of choices by 

students relative to question 6 of the questionnaire: 
To what extent did the course extend your knowledge of 
wastewater treatment technology? Table 59 distributes 
the choices by job types of students and Table 60 dis- 
tributes the choices by education levels of students. 

TABLE 58 

EXTENSION OF KNOV^n^EDGE, 
.STUDENT RESPONSES TO QUESTIONNAlRiE 



CHOICE 


FREQUENCY 


% 


Vory Much 


7 


21.3 


Much 


lA 


42. 4 


Some 


10 


30.3 


Little 


2 


6.0 


None 






Total N- 


33 


lOO.O 




4 " 
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■ TABLE 5"9 

EJCTENSION OF KNOWLEDGE BY JOB TYPE OF RESPONDENTS 
TO STUDENT QUESTIONNAIRE 



Very Much 



Much 



Admin 1st rat o r » 

county planner 
Plant operator 
^Engineer 

Chemist » biologist » 
microbiologist , 
envl r onmen t al 
scientist 

Environmentalist , 
environmental 
specialist 

Auditor 

Technician 
Total (N«33) 



1 
1 

2 



1 
2 



2 
4 
3 



14 




ome Little 



None 



1 
3 
1 



10 



TABLE 60 

EXTENSION OF KNOWLEDGE BY EDUCATION OF RESPONDENTS 
TO STUDENT QUESTIONNAIRE 





Very Much 


Much 


Some 


Little None 


High school graduate 


1 


1 






Some college 


1 


4 


1 


1 


Bachelors degree 


4 


7 


8 


1 


Masters degree 


1 


2 


1 




. Total (N°33) 


7 


14 


10 


2 

\ 
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An analysis was made to quantify the extent to 
which students grew in correct responses from the pretest 
to the post-test. Table 61 shows, a growth scale of ^ 
correct responses, and the number of students and 
percentage of students who realized growth at each incre- 
ment on the scale. , 



TABLE 61 

DISTRIBUTION OF STUDENTS BY GROWTH 
IN SUBJECT MATTER ITEMS TESTED 



Items Growth In 


Number of Students 


% of 


Cumulative 


Correct Responses 


(Frequency.) 


Students 


% of Students 


-1 


1 


2.94 


2.94 


0 


1 


i. 94 


5.88 


1 


3 


f.82 


14.70 


2 


3 


8.82 


23.52 


3 


4 


IK 76 


35.28 




5 


14.72 


50.00 


. 5 


3 


8;82 


58.82 


> 

6 


3 


8.82 


67.64 


8 


5 


14.72 


82.36 


9 


1 


2.94 


85.30 


10 


2 


5.88. 


91.18 


11 


1 


2.94 


94.12 


13 


1 


2.94 


97.06 


17 


1 


2.94 


100.00 




N°34 







Findings, Analysis of Growth: There was considerable 
growth in some subject ^^natter topics and little 
growth in others. Approximately 62 percent of the 
studeni:s :^]tefc^-^hat the course extended their 
knowledge of ^wastewater treatment technology con- 
siderafcly while the others felt that the course 
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increased their knowledge to some degree. The 
only two students who considered that there was 
little extension of their knowledge were employed 
as technicians. Of the thirty-five items on the 
subject matter test, seventeen students, or 50 percent 
of the student^^ had four or less items growth in^ 
correct responses from pretest to post-test and, 
^!hirty-one students, or 91.18 percent of the students, 
had ten or less items .growth in correct responses 
from prete^ to post-test. 
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CHAPTER VI 
CONCLUSIONS AND RECOMMENDATIONS . 

Instrumentation and Assessment Techniques - * 

Conclusions ' _ . 

!• The objectives, established by EPA for 

r - ^-the course in which the instruments- were used in 

this study, were that the trainee after taking, the 
course would be familiar with several stated 
subject matter topics. Such over-generalized 
objiectives communicated little to the trainer or 
trainee as to what was to be taught or learned • 
Lack of specificity in translating course objectives 
into measurable behavioral outcomes limited the 
types of meaningful evaluation that were possible 
on both the subject matter test and the queSjtionnaire 

2. The subject matter test used did not 
contain questions relative to all of the objectives. 
It was not known whether any of the test items were 
established to reflect the needs Of trainees or 
the organizations that they represented* Therefore^ 
there was no way in which validity, reliability, 
and relevance of the test items could be establi^ea* 

'.: . 113 
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3. The questionnaire did not contain a 
suffie^ient number of -questions related to the course 
relevance to the needs of the trainee and those of 
the organiz^^tion that he represented, 

4. Because the same student identification 

it 

code was not used on the questionnaire and the 
subject matter testy it was impossible to correlate 
the data from the two instruments, 

5. "^Multiple-choice questions 1 through 18 
of the student questionnaire appear to be clear 
and appropriately worded for the intended purpose. 
However, the instructions to question 19 did not 
adequately direct more respondees to provide the 
types of meaningful open-ended data that were 
desired. ^ 

6. The single form in the Participant 
Observer Manual on which morale was measured did 
not constitute a full measure of iijorale. Question- 
naire responses related t^many of the variables 
Were also indicators of mo'rale. Negative responses 
expressed, such as: too much time devoted to 
lecturers and too little time devoted to demonstra- 
tions; too much theoretical content and too little 
practical content; the pace is too slow; etc. , were, 
to a degree, expressions by the students that 
personal needs and/or needs of the organizations 

; , 124 . . 
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' . . that sent them were not Satisfied. As a result 

mcbrale was adversely affected ' qin'ce >the prime purpose 
of training was not accomplished, 

7. The participant observer ' techniques 
developed in this study represented a strong 
foundation upon which an extremely valukble tool 
^ for evaluating future trailing courses can be ' , 
built. However, more refined observations and 
mbre detailed entries could have been recorded if 
the observer had been more practiced in using the 
instrument for noting peripheral influences among 
variables. ' 

Recommendations 

1. It is recommended that well stated 
objectives be provided as the underpinning from 
which effective and efficient training can be 
programmed^. Such objectives should communicate 
to the trainees clearly and distinctly what they 
should be^ able to do as a result of the training. 
The quality and utility of every training" action 
' planned depends on the explicitness of stated 
objectives. 

. 2. It is recommended that a criterion*— 

referenced testing system be adopted* This would 
include a specific standard or score against which 
learning is judged. It would focus on what an 

, ' i2n ■ ■ 



ERJC 



116 

individual can or cannot do with respect to a 
* • 

specified' task or objective,. The criterion or . 
standard used must have been validated against job 
behavior or performance in tfte real world. The 
trainee would be provided conditions on the test 
that are simulations /or close* approximations of 
what will be encountered on the job. 

It is also recommended that consideration 
be given to establishing,^^ bank of test items for 
each key objective. By so doing the instructors' 
would be able to assemble, a variety of tests for 
each course served by the bank. As a result of 
receiving test reports instructor;s could make ' 
suggestions fpr improving the test items. Also 
the data from tests could be used, by the instructors 
to improve classroom teaching. 

3. It is recommpi^ded that additional 
questions be added t^ the questionnaire related to 
what the trainee believes to be relative to: the 
extent to which he has achieved the training 
/^Bisijectives, factors re'sponsibile for objectives 
being incompletely achieved, applicability of what 
he has learned to what he will need on the -job, 
and whether the benefits were w^th the time and 
effort. ^ / 

) 126 ■ . . •. 
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(4. It is recornmended that the student's 
name or same identification number as used on the 
test be used on' the questionnaire. As a result, 
additional data would be available relative to 
the correlation of an individual's responses on 
the test with his responses to the questionnaire. . 

5. It is recommended that the instructions 
for responding to question 19 of the student 
questionnaire be rewarded to encQufage more 
responses both in number and in significance. The 
multiple choice 'questions provide quantitative 
dat^ rel-ative to a - small niimber df choices within 
a range. A questionnaire consisting predominantly 
of this type of question has advantages over a 
questionnaire with all or many open-end questions. 
First, a larger response results, because the 
format is much simpler for the potential respondent 
to handle* Second, the d^ta are collected in a 
form which can be much more easily processed and 
analyzed* Having one question, such as question 
19, is considered necessaty, however r because it 
allows the respondent to express himself in his 
own way* Invariably, meaningful additional data 
result. These data can be made more meaningful, 
however, if the ^instructions to the respondent are 
more directive. The respondent should be encouraged 

127 ■ 
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to<»<furnish coiranents relative to considerations 
which have been omitted or .comments which in some 
way provide additional infoirmation to amplify, 
qualify, quantify, or clarify the choices made 
iri the multiple choice questions, 

6, It is recommended that- more resealrch in 
the measurement of morale be conducted^ ix> order to 
develop appropriate techniques for assessing the 
influence of .course variables on student morajfe. 

7. It is recommended that two or more 
untrai]ped participant observers be provided a 
course designe'cJ to improve skills in using the 
instriament. Independent practice irT" observing 
and recording data should be provided. After'" 
tabulating results, observers should be guided in. 
an analysis of the differences and coincidences of 
results. This would provide additional observer, 
training and at the same time establish the need 
for improvements in the technique. ^ 



Future Courses 



Conclusions 



ERIC 



1. Due to the diversified backgrounds and 
needs of the students, the course was not effective 
for all of the students. An analysis of the 
pretests showed that some of the students, before ^ 
taking the course, had considerable knowledge in 
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quite a few of the topics; others had little 
knowledge ^of any of the topics. Also, there was 
a wide variation in the growth in correct responses, 
as reflected by tl:ie pretest and post-test scores. 
For example, some students whose pretests were 
quite high, in number of "co^-rect responses , showed 
considerable growth in the post-test. On the 
other hand, there were students who scored low on 

the pretest, but as low and in one case , lower on , 

'\ 

the post-test. The differences in backgrounds v 

" • - • ^'k 

and the extent to which individual needs were Ihet 
were also reflected. There were wide ranges in 
choices selected on the questionnaire related to 
the effectiveness of such variables as teaching 
techniques, length of course, sequencing of 
subject matter^ pace or progress, instriptors' 
transfer ability, and mprale. f- 

2. The treatment plant visits were considered 
a vital part of the course. However, these were 
not effective because of insufficient indoctrina- 
""tion prior to the visit and because the totlr groups 
were too large for* the students to see the equipment 
and hear the guides. 

3. The instructors' knowledge of the subject 
matter was adequate but there were instructors who 
should improve their skills in terms of their 
ability to transfer knowledge. 
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4. The number of visual aids used was con-*' 
sidered to be about "^right . However, the effective- 
ness of presentation can be improved by innovative 
preparation and by decreasing the length of time 
that some are visible so that th'fe students can 

o 

concentrate on tl^ current subject matter being 
discussed. ^ 

5. There was too much time devoted tQ^ lecture^ 
and too little time devoted to demonstration and 
problem seminars. 

6. There was too much theoretical conteiTt 
and too little practical content. 

7. The morale of the students can be improved 
by considering personalized needs of students and 
sending organizations. 

8. The subject iijatter o£ the training course 
was generally appropriate to the jobs of the students. 

9. The length of the cfe^se and the sequencing 
of the subject matter were acceptable to students. 

10. The physical facilities in which the 
training was conducted were reported as adequate 
and acceptable . 

Recommendations 

1. It is recommended that more care be 
exercised in the registration process to preclude 
those applicants who do not have minimal prerequisites 
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and those whose backgroxinds appear to be already 
beyond that which is intended as a maximum 
baseline. Having done this, the applicant whose 
registration is accented should be required to 
take a pretest at the beginning of the course. 
This provides the training personnel with 
knowledge of those \ireas of the course in which 
an individual has capabilities and those areas in 
which he does not. At that time it may become 
evident that certain topics need not be taught at 
all. , There are, however, other topics which have 
to be taught for the benefit of some of the students 
and other topics whibh should be taught for all 
students. It is not suggested that the training 
personnel delay the planning of the course outline 
until the results of the pretest are known. It ' 
does seem advisable, however, that the cours^ 
topics be planned in modular form. It is likely 
that as a result of the pretest scores the course 
directol: could, for . instance, conduct the course 
in a fashion where all .of the students v>^ould attend 
certain/ topics and alternate topics would be 
offered during other periods. The students should 
tjien be assigned appropriately to sone^ pattern of 
these. By vising this approach an effort would be 
made to maximize, or' at least, optimize the potential 
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benefits offered to all students. It is felt that 
by taking these actions, growth in subject matter 
items will be maximized for each of the students. 
If the student feels that he is growing in knowledge 
and being treated in a personalized manner his 
morale and his attitudes toward many coursfe 
factors may be improved. 

2* It is recommended that improvements in 
both the plann4.ng and the execution of treatment 
plant visits be made. The visits have the potential 
to be the highlight of the course since they serve 
to satisfy a real need of many of the students. 
A thorough briefing just prior to the visits would 
allow the instructor to describe in some detail 
the plants to be visited. The briefing should 
includeN-all preliminaries related to the charac- 
teristics, capabilities, limitations, flow process, 
etc., of each of the plants, providing information, 
and thereby allowing more time at the site for 
observation, comprehi^hsion , and inquiry on the 
part of students. 

At the plant, 'EBe class should be split 
into small groups, each assigned to a guide, and 
the path of the tour should ideally follow the 
flow of the process so that the student can relate 
what "he sees to the briefing in the classroom. 
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Improvement of the plant visits, as reconunended, 

should caai3^ the students to consider the visits 

as a full day of demonstration, as practical 

content, as accelerating the pace of the course, 

* 

and as satisfying an important need^ 

3b It is recommended that action be taken 
immediately and that safeguards be set up to 
prevent a recurrence of halving an instructor who 
lacks the ability to transfer knowledge. There 
are Alternate courses of action, which can be 
taken. One of these would be to assis€ the 
instructor in overcoming this deficiency and 
another would be to use the instructor in a 
different capacity. An instructor who possesses 
little ability to transfer knowledge is detrimental 
to the training program, 

4. It is recommended that, in general, the 
present visual aids concept be continued since over- 
all it appears to be effective. However, there are 
instances when some visual aids are allowed to remain 
in view long after their function has be^en performed. 
'This is distracting to the students and does not* 
allow them to focus their attention on the current 
subject matter. Keeping the aids visible beyond 
their purpose gives- the impression of a course 
containing uninterrupted visuals, 
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STUDENT QUESTIONNAIRE: TRIAL 
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QUESTIONNAIRE 



COURSE NUMBER 



For Items 1 through 7 arid 9 through 17 you are requested 
to select a single answer for each question and place an 
X in the appropriate box. For Item;8 the instructions 
are given. Please answer all of these questions. It is 
at your option as to whether or not you respond to Item 18. 



1. What was the general category of your job at the time 
you took the course? * 

Plant ' ' Biologist? 

Administrator Opetator Engineer Chemist Microbiologist Other 



2n What is the level of your education ? 



Non-High High School Some Bachelor Masters 

SchQol Graduate Graduate College Degree Dep,ree Doctorate 



3. Did you receive an increase in salary as a result of 
completing the course? 



Yes No 



4. Are you still working at the same job that you had when you 
attended the course? 



Yes No 



X 
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5. To V7hat extent was the subject matter of the cours'e 
appropriate to your job? 



Exactly 


Much 


Fairly ;^So Little Not at All 




6, What 


was your 


purpose in enrolling in the course? 


Become 
Instructor 


Increase* 
Knowledge 


Modernize Salary Diversify 
Knowledge Promotion Increase Education Other 





' 7. To what^jext^nt was cour-se content in accordance with 
the cdiffiae Announcement? 



Exactly Much Fairly So Little , Not at All 



8. What is your assessment of how the time should be 

distributed among various types of teaching techniques ? 
(Place an x in one block for each technique.) 







About 




Type ' Much More 


More 


Right Less . 


Much Less 


Lecture 


Discussion 








Demonstration 


Problem Seminars 



9. What is your assessment of the length of the course 
in order to adequately cover the-cotirse material? 



Much too A Little About A Little Much too 
Long too Long Right too Short Short 
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10. How do you rate the course in terms of its theorfetical/ 
practical content ? 



Should be a 




Should be a 


lot more little more 
theoretical theoretical 


Abdut 
. Right 


little more lot more 
practical practical * 


1 



11, How do you rate. the genetal pace or progress of the 
course? 

0 • 



Much too A little About > A little Much 
fast too fast Right top slow too slow 



12. How do you rate the sequencing of subject matter in 
terms of its' having e continuous flow and being 
comprehensible to the students? > 

Excellent Very /Good Good ^ F^ir Poor 




13. How do you rate the instructor (s) ' knowledge of the 
subject matter? 



Expellent Very Good Good / Fair Poor 



14. How do you rate the instructor (s') ' ability to transfer 
his or her knowledge to the students? 



Excellent Very Good Good ' Fair Poor 
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15. How do you rate the physical facilities of the class- 
room? 

o ■ . ^ 

Excellent Very Good Good Fair Poor 



16. How do you rate the utilization of visual aids as 
supportive of instruction? 



Not Quite 

Far too many Few too many Just Right Enough Far too few 



\ 



17. How WQuld you rat-e the general morale of the students? 



Excellent Very Good Good Fair Poor 



18. Personal Comments related to items of the question- 
naire or other comments that you think may be helpful, 
(Use other side if necessary.) * 
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Dear 

I am presently working on a doctoral dissertation 
in which I am evaluating several of the direct training 
courses given by the pffice of Water Programs of the 
Environmental Protection Agency in Cincinnati, Ohio. 

It is my intent that as a result of the research I 
will be able to offer recommendatiohs which will be 
beneficial to and to the students in future courses. 
You are in the unique position of making a significant 
contribution Jbo this effort. Records indicate that you 
completed the course titled "Orientation to Wastewater 
Treatment Operation" on December 21, 1973. ^ 

You can be extremely helpful if you will take 'a few 
minutes to complete the attached questionnaire relative 
to that course and return it to me promptly in the 
enclosed, stamped^ self-addressed envelope. In order 
for the questionnaire to be considered as a valid research 
instrument it is extremely important that you answer 
questions 1 through 17 . It is optional as to whether or 
not you answer question 18. 

Your questionnaire is coded so that your identity 
is known to me. However, you can be sure that your 
questionnaire will not be duplicated and that your 

identity will not be divulged to anyone. ' , \' 

* .*> * ^ 

I thank you for your cooperation. 



George R. Lehnert 
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QUESTIONNAIRE 



COURSE NUMBER 



For Items 1 through 8 and 10 through 18 you are requested 
to select a single answer for each question and place* an 
X in the appropriate box. For Item 9 the instructions 
gire given. Please answer all of these questions. It is 
at your option as to whether or not you respond to Item 19 



li- What was the general category of your job at the time 
you took the course? 



Plant Biologist/ 
Administrator Operator Engineer Chemist Microbiologist Other 



2. What is the level of your education ?^ 



Non-High 
School Graduate 


High School 
Graduate 


Some 
College 


Bachelor 
Degree 


Masters 

Degree Doctorate 





3. Will you receive an increase in salary as a result of 
completing the course? 



Yes Nc 



4. Will you be assigned to another job as a result of 
completing the course? 



Yep No 
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5. To what extent was the subject matter of the course 
appropriate to your job? 
\ 



Exactly Much Fairly So Little Not at All 



6- To what degree did the course extend your knowledge 
of wastewater treatment technology? 



Very much 


Much , Some Little None 


■ 1 - — ■ 


7. What 


* 

was your purpose in enrolling in the course? 


Become 
Instructor 


Increase Modernize Salary Diversify 
Knowledge Knowledge Promotion Increase Education Other 





8- To what extifent was course content in accordance with 
the course Announcement? 



Exactly Much Fairly So Little Not at All 



9- What is your assessment of how the time should be 

distributed among various types of teaching techniques ? 
(Place an x in one block for each technique. ) 



About 

Type Much More More Rifiht Less Much Less 

Lecture 

Discussion 

Demonstration - 

Problem Seminars 
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10. What is your assessment of the length 

of the course in order to adequately cover thfe 
course material? 



Much too A Little About A Little Much too 
Long too Long Right ' too Short Short 



11. How do you rate the course in teCTrts^f its theoretical/ 
practical content? 



Should be a Should be a 




lot more little more About little more lot more 
theoretical theoretical Right practical practical 



12. How do you rate the general pace or progress of the 
course? 



Much too 
fast 


A little 
too fast 


About 
Right 


A little 
too slow 


Much 
too slow 





13. How do you rate the sequencing of subject matter in 
tenns of its haying a continuous flow and being 
comprehensible to the students? 



Excellent Very Good Good Fair Poor 



14- How do you rate the instructor (s) ' knowledge of the 
subject matter. 



Excellent Very Good ; Good^, . Fair, . Poor 
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15. How do you rate the instructor (s) ' ability to 
transfer his or her knowledge to the student? 



Very Good 



Good 



Fair 



Poor 



16- How do you rate the physical facilities of the class- 
room? 



Excellent 



Very Good 



Good 



Fair 



Poor 



17. How do you rate the utilization of visual aids as 
supportive of instruction? " 



Not Quite 

Far too many Few too many Just Right EnoUfih Far too few 



18.^ How would you rate the general morale of the students? 



Excellent 



Very Good 



Good 



Fair 



Poor 



19- Personal commerfts related to items of the question- 
naire or otrher comments that you think may be 
helpful! (Use other side if necessary.) 
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DEFINITIONS 



Teaching Techniques 

« 

Lecture — This is a semiformal talk in which the instructor 
presents facts , concepts , or principle . Explores a 
problem; or explains relationships. The purpose of a 
lecture is to infoym. Some of the appropriate uses of a 
lecture are to (1) orient trainees to course policies, 
rules, procedures, (2) introduce a subject and indicate 
its importance with an overview of the scope, (3) present 
basic material which will set a common background for 
subsequent activities, (4) set a stage for a discussion, 
demonstration or problem seminar,* (5) illustrate the 
application of rules, principles or concepts, and (6) 
review^ clarify, emphasize, or summarize. 

Discussion — Usually occurs at random during a lecture. 
The instructor and students consider the pros and cons 
of a particular facet of the subject matter. 

Demonstration — The instructor performs an operation ot 
does a job, thereby showing the trainees what/to do and 
how to do it. He also indicates why, where, and when it 
is done. This technique is frequently used in conjunction 
with a lecture. 

Problem Seminar — May take the form of a directed group 
discussion. This would include questions, answers, and 
comments from the instructor as well as those from the 
trainees. The technique provides an opportunity to pool 
the knowledge and past experience of the trainees. The 
seminar may take the form of a meeting s«t up specifically 
to fin<i an answer to a question/or a solution to a problem. 



Theoretical/Practical Content 

Theoretical Content — Classroom activity, regardless of 
what teaching technique is utilized, e.g. lecture, dis- 
cussion, demonstration or problem seminar, which is devoted 
to generalization, pi^^inciples , hypothetical situations , 
concepts , basic propositions , and speculative thinking. 

Practical Content — Classroom activity, regardless of teach- 
ing technique used, which is related to situations in which 
the theoretical concept.^ are put into specific applications, 
usages, and experiences. 
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Technical/Non Technical Content 

Technical Content — Theoretical and practical subject matter 
related to the fields of engineering, physical sciences, 
and life sciences. May be presented as equations, mixtures 
of ingredients, phenomena, concepts, and applications. 
May be presented" in lecture, discussions, demonstration, 
or problem seminar. 

' ' • . 

Non Technical Content— Theoretical and practical subject 
matter which is not related to that which is defined as 
technical. May be presented in lecture, discussion, 
demonstration or problem seminar. 
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C0MPLE5PE TOPIC OUTLINE 



Orientation to Wastewater Treatment Operation 

Course 173 

Overview of VJast^water Treatment » ' 

1. Major functions of conventional treatment 

2. Identification of major stages of conventional 

treatment 

3. Schematics and examples of common operations 

4. Optional methods of treatment 

> , 

Treatment Opera^iional Control 

1. Major effluent qr water quality requirements 

2. Illustration of a sample organization and the 

chain of command for implementation 
3* Who does what in functional arrangemehts 
4. Services available to the local treatment 

Qperator. 

Nature ^f Objectionable Materials to be Treated 

,"4. Characteristics of used water resulting from - 
human activities 
2. Common hazards to water reuse such as pathogens, 
oxygen demanding materials, sediment, radio- 
active materials,^ heat, toxic agents, oils,, 
acids, taste, odor, and suspended or dissolved 
material "out-of-place . " ' 

Unit Operations in Wastewater Treatment 

1. Liquid/solids separations: sedimentation, 

screening, filtration 

2. Stabilization pr oxi^^ion: biological, 

chemical or physi^c^f stabilization 

3. Pumping, conveying ^'r other transfer operations 

4. Drying, neutralization, disposal and disinfection 

Sampling for Tests and Measurements 
• 

1. Site selection for the particular test for purpose 

2. Types of samples 

3. Mixing requirements 

4. ' Influences of criteria variability relative 

to location, time and reactivity 

5. Scheduling requirements for the situation test 

or objective 15V * 
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P, Measurement and Testing Requirements 

1, Flow measurements into, out o£, or in process 

streams . / . 

2, Tests to identify problem identity 

3, Tests to measure concentrations 

4, Material balance concepts in record or 

process control 

5, Validation of measurement or test results 

Treatment Plant Tour and Discussion — Guided tour 
through a secondary treatment facility led by a 
knowledgeable tour leader, to observe: 



1, Sequence of operating routines 

2, Functional equipment 

3, Nature of coi:itrols ; 

4, Operating requirements \ - ^ 
5^ Process problems 

6/ A discussion session for clarification and 

orientation purposes on observations, their 
significance, and corrective action 



H, Collection System Considerations 

1, Collection as the first stage of treatment - 

2, Influences of the collection system upon 

nature of , variability and conditions 
of the flow to be treated 

3, Sources of extraneous problem discharges 

resulting from routine or contingency 
nature (Accidents, midnight dumps, storms, 
illegal connections , etc. ) 

I, Screening, Grit Removal and Grinding 

1, Needs for early removal of rocks, roots, rags, 

sand and other troublesome objects 

2, Equipment options on a functional and operating 

basis 

3, Disposal options and their effects upon recycle , 

costs, and acceptability 

J, Wastewater Pumping 

1, Remote lift stations and main pumping station 

review . , 

2, Equipment characteristics and functional 

advantages or limitations (centrifugal , 
screw, positive displacement , ejection , and 
piston) 

3, Pumping problems: (plugging, wear, corrosion, 

alignment adjustment bearing and seals) ! rjo 

4, Variability and standby requirements 
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K, Clarification and Sedimentation 

1. Nature of particles, discrete or flocculent 

ancj effects upon settling 

2. Settling variables such as particle size, 

relative density , and liquid temperature, 
* depth, velocity or turbulq^ce 

3. Sedimentation equipment and appurtances for 

various use's including options in geometry, 
inlet and outlets, collection or discharge 

4. Operational controls for sludge withdrawal, 

overflow, skimmings , turbulence , differences : 
primary and secondary processes 

L. Flow Distribution and Control 

V Importance of flow "control among process units 
relative to stop/stairt , limits , routing, 
equalization, among multiples^ 
Types of equipment and their purposes, such as 
splitter boxes, check valves, diversion units 
or level controls, gate, butterfly and plug 
valves 

Operational advantages and limitations of each 
Aeration of Process Waters . ' 

1. Aeration with respect to freshening growth 
stabilization mixing and where it is used 

2. How achieved, such as creation of air/liquid 
interface area by spreading, mixing, pumping 
and paddling 

3. Equipment options such as compressors, diffusors, 
turbines and pumps 

4. Operational controls and influences such as 
interface area , surface contamination , oxygen 
deficit, and mixing energy 

N. Activated Sludge Treatment 

1. Basic process of suspended growth stabilization 

of wastewaters with separation and recycle of 
the active sludge 

2. Selection of common process medications and 

performance characteristics 

3. Operational variables such as DO, load ratio 

or solids retention time, settling rates 
and performance criteria 
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O. Trickling Filtration Treatment • 

1* Basics of the attached slime growth 



stabilization process 

2. Process modifications and purposes for 
upgrading performance, versatility, cpst/ 
effectiveness and dependability 

3. Operational capabilities and controls 



Oxidation Ponds 



Types of oxidation ponds with particular 

attention to algae and sewage slime 

activities in facultative ponds 

Pond variables such as area, temperature, 

light, soil permeability, evaporation rate, 

circulation, seeding and load 

Important considerations for operational 

control 



Q. Anaerobic Digestion 



1. The nature of stabilization in the absence 
of free molecular oxygen and the products 
of the conversion, such as gas, liquid 
recycle; and solids 

2. Common equipment and appurtenances 

3. Process controls such as loading, mixing 
temperature, and acid/alkaiinity balance 



R. Coagulation 

1. Basic factors in coagulation and flocculation 

2. Where may coagulation be used in supplementa- 
tion or: separate treatment 

3. Chemicals used 

4. Advantages and limitations of coagulation 

5 . Control techniques 



S. Carbon Adsorption 

1. Adsorption and activated carbon characteristics 

2. Carbon adsorptipn applications in wastewater 

3. Advantages and limitations 

4 . Control techniques 

T. Sludg<3 Dewatering Operations 

1. General characteristics of wastewater sludges 

2. Dewatering options such as pressure or vacuum 

filtration, centrifuge, land or beds, lagoon 
bed or surface filters 
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3 . Performance characteristics 

4. Control variables 

U. Incineration of Solids a 

1. Types of incinerator equipment^ multiple 

hearth, fluid bed, and kiln 

2. Natiif-e of residues: ash, gases, dust, 

fumes or soot 

3. Control of residue disposal 

V. Land Disposal of Sludge or Liquids 

1,. Recycle advantages of nutrients and water 

2. Hazards of land disposal and control of 
^r>^ public opinion, pathogens, odors, 

leachates, pooling, plugging^ soil toxicants, 
poor application and -maintenance 

3. Application methods: spray, ditch, trench- 

ing, fill and cover 

4 . Cultivation 



W. Recycle Considerations 

1. Recognition and consideration of recycle 

streams and their effects upon treatment 
plant loading, process problems, and 
process efficiency 

2. Origin nature and characteristics of recycle 
, streams such as ground screenings, wash 

down , eluates , liquid concentrates from 
thickening , digestion , filtration , drying , 
filter backwash er sludge drainage 

3. Contributions related to plant design, take 

out and burial , good housekeeping , 
programmed feedback , side reprocessing 
of concentrates 

X. Operation and Maintenance Considerations 

1. Budget for salaries, O&M, materials, replace- 

ment 

2. Records for cash outlay, operations, events/ 

performance and maintenance for planning 
and performance guidance 

3 . Maintenance requirements such as inspection , 

cleanup, adjustment , lubrication , protec- 
tion, follow-up for repair and replacement 
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Y. Operator Personnel Training 

1. Relationships of operating personnel 

responsibilities capabilities and 
treatment pejrf ormance 

2. Relationship to attraction, retention, 

and training for entry, level; and 
updating and upgrading personnel 

Z. Disinfection of Treated Discharges 

'J 

1. Definition and characterization of idis- 

infection practice and protection 

2. Variables such as concentration, time, 

'temperature , mixing, tr^eatment 
efficiency, and form ,of disinfectant 

3. Recommendations for improved safety and 

effectiveness 

AA. Considerations for "Package" Wastewater Treatment 

1. Occurrences for home^, boats, work crews, 

parks, highways, etc, and numbers involved 

2. Types such as septic tanks,, biological 

aerobic, and chemical 

3. Control efforts such a-s subsurface disposal, 

area operation and maintenance, fail safe 
design, and area treatment 
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SUBJECT MATTER ^JEST r 

ORIENTATION TO WASTEWATER TREATMENT OPERATIONS 

COURSE 173 . ' 

Student Coda Identification 



Read the question carefully; fill in the blanks^ to make a 
complete and valid statement or check your selection among 
applicable items — true *(T)> false (F) or multiple choices 
as indicated. 



1* 



A good quality water is intended to be freo from 
certain objedtionable characteristics that limit 
acceptability- * Mud of sediment is one of these 
"Freedoms. Name three others; 



2- The water content of untreated domestic or municipal 
wastewaters is approximate lyv: check one, 

90.0% 99.9% 98.2% 99.44%_ 



3. The National Pollutional Discharge Elimination System 
(NPDES) includes a self -monitoring program for ^testing 
treated discharges to indicate compliance with opera- 
ting permit requirements. The major measured criteria 
values or tests specified include: (name fivQ) 



4. Environmental acceptability of the water" to support 
life for a desired community of organisms is a 
primary surface water quality objective. 
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High quality surface water is likely to include a 
larg^ variety of aquatic organisms ^with relatively 
small numbers each. A stream containing/ no^ fish 
life while bacteria are extremely numerous ig likely- 
to be„ , 



Compliance with the discharge permit requirements is 
inteiided to insure that the receiving water quality 
after discharge addition will be acceptable for its 
intended use. 

T F ^ 



Pathogens are' disease producing organisms. Coliform 
group .organisms generally are pathogens, 

T F i 

• • . — ji 

A result indicating 5,000 fecal colif orms/100 ml based 
upon approved . sampling and testing proce4ures, 

a. implies ^, b. is absolute proof , c. doesn't 

suggest that- pathogens may be present in the 

sampled water (check one) . 



The dissolved oxygen (DO) test is- an important water 
quality index befcause: (check .one) 

a. All aquatic organisms require DO to survive * / . 

b. Poc>r quality water always indicates an - 

absence of DO^ . ^ 

c. Many desirable aquatic organisms require acceptable 

DO concentrations to survive 



Sample BOD results are based upon the change in two 
or more DO tests covering a known interval of time 
under specific storage conditions. 



BOD results indicate biological availability in terms 
of oxygen demand. This is one of several criteria 
needed to characterize and to interpret the^^uality of 
the water mass sampled. ^ 
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12. The pH value is an index of (check one) 

a. The amount of acid in a sample 

b. Acid activity 

I c. Conductivity of the sample 



13. Stages of treatment, such as preliminary, primary,, 
secondary and advanced, are more appropriately 
described in terms of the materials removed or 
modified therein; ^ ^ . 

a. NajTie three' classes of material intended* to be 
removed during preliminary treatment f; 



b. Primary treatment is intended for removal of 
or ' pollutants 

c. Secondary treatment is intended to staJDilize or to 
remove and 



contaminants'. 

d. Advanced treatment may involve biological, chemical 
« or physical operations; the main idea is to meet 

some specified water ' 

- ^ • exceeding those for most con ven- 

tional treatment. 

14. The material rem^^^d or function intended determines 
unit operations or processes built into the treatment 
- facility. II^P,^:ng and, clarif ication"* are' two common 
unit operations * Name five others : 



, 15. Regardless of hardware or processes in the treatment 
facility the main objectives are to implement' three 
of the followirig five functions in an acceptable 
manner. (Check three) 

a. Keep the taxpayer unhappy 



b. Separate, objectionable materials from water 

166 
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c. Stabilize unstable components J . 

d. Provide an occupation for misfit employees 

e. Dispose of removed residues ^ 



16. Which one of the three selected functions in question 
15 are likely to be associated with most of the. cost ^ 
operation, and public relations problems? 



* 0 
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KEY-SUBJECT MATTER TEST 
ORIENTATION TO WASTEWATER TREATMENT OPERATIONS 

COURSE 173 



Point Score 



1. Objectionable: 



Sedimqnt 

Infectious or toxic 

material 
Grease Oil Scum 
Taste odor color 
Nuisance hquatic growth 



2. 
3, 



99.9% ^ 
Major NPDES Criteria: 



BOD5 

Suspended or^ Settle- 
able Solids 

pH 

Chlorine residual 
Fecal coliform group 



4. True 

5. Polluted, Objectionable, Low Quality 

6. True 

7. False 

8. a. Implies 

9. c. Many desirable organisms require some 

minimum DO 

10. True 

11. True 

12. b. Acid activity 

13. a. Rocks, roots/ rags, gravel, trash, etc. 

b. Settleable sdlids or sludge, floatable 

grease, oil|, scum 

c. Soluble or^ dissolved, rfon-settleable , 

^ colloidal solids 

d. Quality criteria, quality index, reuse 

specification 



1 
5 



1 
1 
1 
1 
1 

1 
1 
1 
1 
3 
2 
2 
1 
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Aeration 

Disinfection 

Coagulation 

Oxidation 

Neutralization 

Equalization 

Screening 



Activated Sludge 

Trickling Filtration 

Oxidation Ponds 

Filtration 

Absorption 

Drying 

Mixing and Others 



b. c. e. Separation , stabilization^ 
disposal 

e. disposal 



Total 



\ 
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